* Cantinho Satkeys

Refresh History
  • JPratas: dgtgtr Pessoal  49E09B4F k7y8j0
    Hoje às 17:19
  • FELISCUNHA: Votos de um santo domingo para todo o auditório  4tj97u<z
    03 de Novembro de 2024, 10:49
  • j.s.: bom fim de semana  43e5r6 49E09B4F
    02 de Novembro de 2024, 08:37
  • j.s.: ghyt74 a todos  4tj97u<z
    02 de Novembro de 2024, 08:36
  • FELISCUNHA: ghyt74   49E09B4F  e bom feriado   4tj97u<z
    01 de Novembro de 2024, 10:39
  • JPratas: try65hytr Pessoal  h7ft6l k7y8j0
    01 de Novembro de 2024, 03:51
  • j.s.: try65hytr a todos  4tj97u<z
    30 de Outubro de 2024, 21:00
  • JPratas: dgtgtr Pessoal  4tj97u<z k7y8j0
    28 de Outubro de 2024, 17:35
  • FELISCUNHA: Votos de um santo domingo para todo o auditório  k8h9m
    27 de Outubro de 2024, 11:21
  • j.s.: bom fim de semana   49E09B4F 49E09B4F
    26 de Outubro de 2024, 17:06
  • j.s.: dgtgtr a todos  4tj97u<z
    26 de Outubro de 2024, 17:06
  • FELISCUNHA: ghyt74   49E09B4F  e bom fim de semana
    26 de Outubro de 2024, 11:49
  • JPratas: try65hytr Pessoal  101yd91 k7y8j0
    25 de Outubro de 2024, 03:53
  • JPratas: dgtgtr A Todos  4tj97u<z 2dgh8i k7y8j0
    23 de Outubro de 2024, 16:31
  • FELISCUNHA: ghyt74  pessoal   49E09B4F
    23 de Outubro de 2024, 10:59
  • j.s.: dgtgtr a todos  4tj97u<z
    22 de Outubro de 2024, 18:16
  • j.s.: dgtgtr a todos  4tj97u<z
    20 de Outubro de 2024, 15:04
  • FELISCUNHA: Votos de um santo domingo para todo o auditório  101041
    20 de Outubro de 2024, 11:37
  • axlpoa: hi
    19 de Outubro de 2024, 22:24
  • FELISCUNHA: ghyt74   49E09B4F  e bom fim de semana  4tj97u<z
    19 de Outubro de 2024, 11:31

Autor Tópico: Data Lake, Firehose, Glue, Athena, S3 And Aws Sdk For .Net  (Lida 101 vezes)

0 Membros e 1 Visitante estão a ver este tópico.

Online mitsumi

  • Moderador Global
  • ***
  • Mensagens: 115810
  • Karma: +0/-0
Data Lake, Firehose, Glue, Athena, S3 And Aws Sdk For .Net
« em: 30 de Setembro de 2022, 08:15 »


Last updated 3/2020
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz
Language: English | Size: 746.03 MB | Duration: 1h 55m

Leverage AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK to build a Data Lake.

What you'll learn
How to build a Data Lake using Firehose API for .NET, S3, AWS Glue and Athena
Requirements
You must have an active AWS Account to utilized the included code.
Prior knowledge of AWS Web Services would be helpful, but not needed.
Description
The purpose of this class is to demonstrate a proof of concept using a series of lab exercise's (in the AWS Console using AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK, with C# code using the AWS SDK) of building a Data Lake in the AWS ecosystem.In this class, we will be sending data from a local SQL Server database to AWS RDS securely, and automatically.I am utilizing the .NET SDK for AWS, however, this could easily be migrated to your language of choice once you understand the concepts that I am teaching. I will be providing the full working source code of this proof of concept.I will also provide a working example of creating Parquet files and sending to S3 (without using Firehose).
Overview
Section 1: Introduction
Lecture 1 Introduction
Section 2: Overview of AWS Web Services in a Data Lake
Lecture 2 AWS Serverless pieces to our Data Lake jigsaw puzzle
Section 3: AWS RDS and S3
Lecture 3 S3 Bucket creation
Lecture 4 RDS creation
Section 4: AWS Kinesis Firehose, C# and the AWS SDK
Lecture 5 Creating Kinesis Data Firehose delivery streams
Lecture 6 Console .NET core C# entity-framework project
Lecture 7 Kinesis Firehose C# API class
Lecture 8 Kinesis Firehose C# API send data example
Section 5: AWS Glue, Athena, ETL jobs, Triggers, and using Hangfire
Lecture 9 Creating Glue Crawlers
Lecture 10 Query Data in Athena using SQL
Lecture 11 Creating AWS ETL jobs
Lecture 12 Hangfire - Automation
Section 6: AWS Lake Formation, Cognito and Parquet .NET
Lecture 13 AWS Lake Formation
Lecture 14 AWS Cognito
Lecture 15 Parquet .NET - Alternative to using Firehose
Section 7: Final thoughts and advice
Lecture 16 Conclusion
AWS developers interested in learning about building a data lake using AWS services and the AWS SDK.


Download link

rapidgator.net:
Citar
https://rapidgator.net/file/359e50a8e904bf48fa46ac9655a2182b/ashdq.Data.Lake.Firehose.Glue.Athena.S3.And.Aws.Sdk.For..Net.rar.html

uploadgig.com:
Citar
https://uploadgig.com/file/download/534f800Ba5Ff29c2/ashdq.Data.Lake.Firehose.Glue.Athena.S3.And.Aws.Sdk.For..Net.rar

nitroflare.com:
Citar
https://nitroflare.com/view/2168C37148CDE5B/ashdq.Data.Lake.Firehose.Glue.Athena.S3.And.Aws.Sdk.For..Net.rar

1dl.net:
Citar
https://1dl.net/r2ooyzke5p7j/ashdq.Data.Lake.Firehose.Glue.Athena.S3.And.Aws.Sdk.For..Net.rar.html