Demet takes you deep into pipe, a tool that allows anyone at Automattic to build solid machine learning models.
… Continue readingCategory: Data Engineering
Real-Time Elasticsearch Indexing on WordPress.com
Love databases, indexing, and Elasticsearch gymnastics? Greg Brown walks us through the indexing sausage factory on WordPress.com.
… Continue readingMay the Bot Be With You: How Algorithms are Supporting Happiness at WordPress.com
Charles Earl reports on Elfbot, a machine learning project geared to helping Happiness Engineers provide fast, efficient, wonderfully human support to WordPress.com users.
… Continue readingBulk Log Analytics With Hive
Leveraging the distributed powers of MapReduce to perform custom log analysis or some one-time queries on the raw data is fast and easy and you don't even have to build a complicated ETL process to do it. The data engineering team at WordPress.com recently used this approch to query tens of billions of log lines with just a couple minutes of work.
… Continue readingState of WordPress.com Elasticsearch Systems 2016
We get asked periodically about how extensively we are using Elasticsearch. And it has come up twice in the past week, so time to write a blog post. We are constantly expanding what we are using Elasticsearch for and so although some previous posts have broadly define what we are doing, they don't really capture … Continue reading State of WordPress.com Elasticsearch Systems 2016
