Evolution of confluent-kafka-python — 去年底在香港 ( PyCON HK 2018) 分享了一些使用 Apache Kafka 的心得。會去分享這個主題，是因為實際使用後發現在 Python 環境使用 Kafka 相較於原生的 Java/Scala，還是會踩到很多雷阿阿。事隔近一年，沒想到在這段時間 Kafka 對 Python 的支援有蠻多進展的，用這篇文來 follow up 整 …

Setup Selenium within 30 seconds! — Yeah yeah, I know that there are already numinous posts and articles talking about Selenium. But how long does it take to setup Selenium and ready to do web scraping? In this post, I will show you the easiest way to setup Selenium I have ever seen. Assumptions You know what…

Let your crawler works correctly and efficiently. — From my previous post, you already know how to setup Selenium and ChromeWebDriver for web scraping. Now let’s jump into the rabbit hole to see how to build a robust crawler. The Basic Crawler In the beginning, your crawler with ChromeWebDriver may look like this: from selenium import webdriver driver = webdriver.Chrome() driver.get('http://www.google.com') …

How to get trusted HTTPS in development environment — HTTPS everywhere! 現在無論是開發 web 還是 chatbot 應用，都很易碰到要提供 HTTPS 連線的需求。這篇文章提供我知道的幾種作法供大家參考～ TL; DR 以下方案可以讓您建立 HTTPS endpoint，其憑證由受信任的 CA 所簽發，適合用在開發環境上，而且免費！ Heroku Ngork xip.io + Let’s Encrypt + …

Understanding OpenID Connect — In this post, I would like to provide a brief understanding of the OpenID Connect (OIDC) without having to read the specs. This post builds upon what we learned about OAuth2 in the previous post in this series. …

瞭解 OpenID Connect 認證機制 — Hihi~ 上次介紹完線上認證授權技術兩本柱中的 OAuth 2.0，這次要跟大家介紹的是 OpenID Connect (OIDC) 。相較於 OAuth 2.0 提供的授權機制，OIDC 提供的認證功能，在大家日常生活中可能會更常用到喔！上圖是大家出國玩常用到的 Booking.com ，你可以看到她的註冊畫面可以選擇用 Facebook 或 …

OAuth 2.0 委任授權技術簡介 — 大家有聽過 OAuth 及 OpenID Connect (OIDC) 嗎？這次接到 L 社神秘任務，來跟大家說一說這兩個融入每個人日常生活中的認證授權技術。平時大家可能不太留意，其實現在常用（X）天天用（O）的各種各種線上服務，例如 Google、Facebook 及 LINE 提供的各種應用，都是基於這次要講的這兩個技術標準來建構他們的認證授 …

Introduction to OAuth 2.0 — Have you ever heard OAuth or OpenID Connect (OIDC)? They are widely used in our daily lives without much awareness. Google, Facebook, LINE and many service providers have already built their authentication and authorization mechanisms on their services we use every day based on these two technologies. This post is…

Thread and signal in Linux — 上一篇文章整理Linux的process群組（session、process group）與其signal傳遞機制。若要處理的case是像JVM這種喜歡single process multi thread的程序架構，就會需要瞭解thread/thread group這一階層的概念。 Linux thread 大家知道在linux thread的機制是後來加上去的，所以底層在很多地方是將thread和process一視同仁。整理linux thread機制如下： linux 有一個類似fork的clone syscall，和fork的差別它起的process會和parent process share context/resource等很多資源 在linux thread是以LWP的方式實現，也就在底層行程管理和排程將thread和process一視同。thread是一群比較特別的process，他們彼此share資源。