View profile

SF Data Weekly - Data at Uber, Airflow 101, Event Driven Systems & Kafka

October 22 · Issue #90 · View online
SF Data Weekly
Our Pick
Ten Practical Big Data Benefits
Data Pipelines
Uber's Big Data Platform: 100+ Petabytes with Minute Latency | Uber Engineering Blog
Uber's latest Big Data platform with incremental data ingestion.
Event Driven 2.0 | Confluent
Event-first and event streaming pattern.
Airflow 101: Start Automating Your Batch Workflows With Ease
An example of Directed Acyclic Graph (DAG) built in the article.
Data Storage
How to Manage Connections Efficiently in Postgres, or Any Database
Performance drop with increase in number of connections.
Why Physical Storage of Your Database Tables Might Matter
Solving Spark to Postgres data writing problems.
Setting up Read Replica Clusters with HBase on Amazon S3 | AWS Big Data Blog
Multiple HBase clusters can connect to the same HBase root directory in S3.
Data Analysis
Multi-Class Text Classification with PySpark | Towards Data Science
Data Visualization
An Overview of Every Data Visualization Course on the Internet
Data-driven Products
Data Engineering Podcast – The Show About Modern Data Management
Data Engineering Jobs
Data Engineer - Stanford University
If you want to post a job for your company, you can do it here.
Did you enjoy this issue?
If you don't want these updates anymore, please unsubscribe here
If you were forwarded this newsletter and you like it, you can subscribe here
Powered by Revue
650 California St., San Francisco, CA 94108