View profile

SF Data Weekly - Facebook's Data @ Scale, Scaling Redshift, Airflow & Luigi Workflows, SQL at Scale, Tableau & plotly.js

December 5 · Issue #95 · View online
SF Data Weekly
Our Pick
Data @Scale Boston Recap and Videos | Facebook Code
Data Pipelines
Data Pipelines, Luigi, Airflow: Everything You Need to Know
Streaming in the Clouds: Where to Start | Confluent
Confluent Replicator as a bridge connecting data in the cloud.
Implementing Enterprise Integration Patterns with AWS: Publish-Subscribe Channels
Request-response integration using cloud native messaging in AWS
Data Storage
Scale your Amazon Redshift clusters Up and Down in Minutes
Redshift elastic resize can be done using the AWS console, or with a simple API call.
Five Cool Things I Learned at the PostgreSQL Conference Europe 2018
Replicating MySQL tables on S3 as Parquet: DanaDB
Having data in the S3 lake is suitable for processing and analysis - OLX big data team.
Data Analysis
SQL at Scale with Apache Spark SQL and DataFrames — Concepts, Architecture and Examples
Performance of Shark, Impala and Spark SQL on Big Data benchmark queries.
Tableau for Exploratory Data Analysis(EDA) – Towards Data Science
Visualizing scattered data - Tableau makes this possible with a few clicks.
Data Visualization
An Introduction to plotly.js — An Open Source Graphing Library
Data-driven Products
Deploying a Keras Deep Learning Model as a Web Application in Python
Data Engineering Jobs
Data Engineer - Indeed
Data Engineer - Capital One
If you want to post a job for your company, you can do it here.
Did you enjoy this issue?
If you don't want these updates anymore, please unsubscribe here
If you were forwarded this newsletter and you like it, you can subscribe here
Powered by Revue
650 California St., San Francisco, CA 94108