Self-paced, on demand course with hands-on lab
Prophecy for Data Engineering Lab Environment
Welcome to Prophecy for Data Engineering! This course is here to help you begin your journey in data engineering.
It doesn't matter where you are in your career, whether you're a leader in the data industry, an experienced developer, or new to Spark and trying to solve business problems. You will gain valuable insights from this course.
We will focus on practical exercises. Imagine yourself as a data engineering and architect at the e-commerce company called "rainforest.biz".
We will begin by organizing the data from platforms like Salesforce and operational databases. We will clean and standardize the data to create an efficient data model. Using this data model, we will build applications for various real-world scenarios. Throughout this journey, you will constantly learn new things.
- We will build a spreadsheet export for your sales finance department, where we will explore data modeling and transformation concepts. Since the finance department really cares about the quality of data, we’re going to also learn about how to setup unit and integration tests to maintain high quality.
- Sales and marketing campaign performance data upload that can be ingested back to Salesforce, where we will explore advanced extensibility concepts that will allows us to create and follow standardized practices.
- A dashboard directly on Databricks for your product team to monitor live product performance. Here we we will also learn a lot about observability and data quality.
- The great thing is that all the code we'll be using is open-source and easy to access. You'll be able to use what you learn in this course for your own projects.
Meet the instructors
Modern enterprises build data pipelines with Prophecy
