View profile

SF Data Weekly - Airflow Pipelines, Scaling DBs, Azure Analytics, SQL at Scale with Spark

October 30 · Issue #91 · View online
SF Data Weekly
Our Pick
The Increasingly Data-Driven World | IDG TechTalk
Data Pipelines
Building a Big Data Pipeline With Airflow, Spark and Zeppelin
Data visualizations with Zeppelin.
Closing the Customer Journey Loop with Amazon Redshift at Equinox Fitness Clubs | AWS Big Data Blog
The pipeline built by Equinox Fitness Clubs.
Apache Kafka on Kubernetes – Could you? Should You?
Data Storage
Optimizing BigQuery: Cluster Your Tables | Google Cloud Platform
Same query, same results, but different time and data used.
Are You Secure Enough Outside the Cloud? | AWS Cloud Enterprise Strategy Blog
Data Analysis
SQL at Scale with Apache Spark SQL and DataFrames — Concepts, Architecture and Examples
The Spark Ecosystem.
Redefine Data Analytics with Modern Data Warehouse on Azure | Blog | Microsoft Azure
Benchmarking data warehouses on TPC-DS queries, 1TB in size.
Data Visualization
Visualizing Patterns on Repeat | FlowingData
Temperature deviation over 135 years.
Data-driven Products
3 Inspiring Earth Observation Apps Built Using FME Cloud
Automated vegetation
Automated vegetation health monitoring with FME in the AWS cloud.
Data Engineering Jobs
Data Engineer - Blockchain Works
If you want to post a job for your company, you can do it here.
Did you enjoy this issue?
If you don't want these updates anymore, please unsubscribe here
If you were forwarded this newsletter and you like it, you can subscribe here
Powered by Revue
650 California St., San Francisco, CA 94108