Topic:
Over the last few years the term Data Engineer has popularized in the IT industry and there are millions of openings found across the world posted on job sites. With the amount of data being generated and the challenges with leveraging it, this need for data engineering is not going away any time soon.
But what is data engineering? How does it relate to other IT roles like BI or ETL developer? And where can you learn and get yourself up to speed on this field? Azure offers Synapse Analytics as an all-encompassing analytics development service that can be great for learning as well! Microsoft took the power of the MPP database engine of SQL DW and added more powerful capabilities, full big data integration through Spark and data pipeline authoring to bundle the entire data engineer workflow in one environment.
In this demo-heavy session we will go over the main concepts behind Data Engineering and Synapse, with demos on how different tasks are done using this cloud-based integrated environment.
Speaker:
Warner Chaves
Warner is a SQL Server Certified Master and SQL Server Principal Consultant at Pythian, a global Canada-based company specialized in DBA services. A brief stint in .NET programming led to his early DBA formation working for enterprise customers in Hewlett-Packard ITO organization. From there he transitioned to his current position at Pythian, managing multiple customers and instances in many versions and industries while leading a highly talented team of SQL Server DBAs. When he’s not working out of his office in Ottawa, Ontario he can be found on the sandy beaches of his home country of Costa Rica.