* Cantinho Satkeys

Refresh History
  • j.s.: bom fim de semana  4tj97u<z
    Hoje às 11:23
  • j.s.: ghyt74 a todos  49E09B4F
    Hoje às 11:23
  • JP: try65hytr A Todos  4tj97u<z 2dgh8i k7y8j0 r4v8p
    12 de Junho de 2026, 05:28
  • JP: try65hytr Pessoal  2dgh8i k7y8j0 yu7gh8
    10 de Junho de 2026, 03:47
  • j.s.: passem por aqui [link]
    09 de Junho de 2026, 20:57
  • j.s.: um anonimo contribuiu com €10,00  h7t45
    09 de Junho de 2026, 20:56
  • j.s.: try65hytr a todos  49E09B4F
    09 de Junho de 2026, 20:56
  • m1957: Vamos todos colaborar para que o forum continue! Bom fim de semana.
    06 de Junho de 2026, 02:24
  • cereal killa: dgtgtr pessoal  49E09B4F
    04 de Junho de 2026, 14:49
  • j.s.: [link]
    03 de Junho de 2026, 10:01
  • j.s.: fica aqui a descrição do numero da conta
    03 de Junho de 2026, 10:00
  • j.s.: podem fazer, como tem sido sempre feito, por transferencia bancaria
    03 de Junho de 2026, 10:00
  • j.s.: por lapso não foi indicado  como podem ajudar o  forum
    03 de Junho de 2026, 09:58
  • j.s.: bo ghyt74 a todos  49E09B4F
    03 de Junho de 2026, 09:57
  • JP: try65hytr Pessoal  4tj97u<z 2dgh8i k7y8j0 classic
    02 de Junho de 2026, 04:05
  • FELISCUNHA: Bom dia , votos de um santo domingo para todo o auditório  4tj97u<z
    31 de Maio de 2026, 11:40
  • bruno mirandela: boa tarde a todos
    30 de Maio de 2026, 18:04
  • j.s.: [link]
    30 de Maio de 2026, 17:41
  • j.s.: tenham um bom fim de semana  49E09B4F
    30 de Maio de 2026, 17:38
  • j.s.: dgtgtr a todos  49E09B4F
    30 de Maio de 2026, 17:38

Autor Tópico: Data Lake, Firehose, Glue, Athena, S3 And Aws Sdk For .Net  (Lida 345 vezes)

0 Membros e 1 Visitante estão a ver este tópico.

Offline mitsumi

  • Sub-Administrador
  • ****
  • Mensagens: 133304
  • Karma: +0/-0
Data Lake, Firehose, Glue, Athena, S3 And Aws Sdk For .Net
« em: 30 de Setembro de 2022, 08:15 »


Last updated 3/2020
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz
Language: English | Size: 746.03 MB | Duration: 1h 55m

Leverage AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK to build a Data Lake.

What you'll learn
How to build a Data Lake using Firehose API for .NET, S3, AWS Glue and Athena
Requirements
You must have an active AWS Account to utilized the included code.
Prior knowledge of AWS Web Services would be helpful, but not needed.
Description
The purpose of this class is to demonstrate a proof of concept using a series of lab exercise's (in the AWS Console using AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK, with C# code using the AWS SDK) of building a Data Lake in the AWS ecosystem.In this class, we will be sending data from a local SQL Server database to AWS RDS securely, and automatically.I am utilizing the .NET SDK for AWS, however, this could easily be migrated to your language of choice once you understand the concepts that I am teaching. I will be providing the full working source code of this proof of concept.I will also provide a working example of creating Parquet files and sending to S3 (without using Firehose).
Overview
Section 1: Introduction
Lecture 1 Introduction
Section 2: Overview of AWS Web Services in a Data Lake
Lecture 2 AWS Serverless pieces to our Data Lake jigsaw puzzle
Section 3: AWS RDS and S3
Lecture 3 S3 Bucket creation
Lecture 4 RDS creation
Section 4: AWS Kinesis Firehose, C# and the AWS SDK
Lecture 5 Creating Kinesis Data Firehose delivery streams
Lecture 6 Console .NET core C# entity-framework project
Lecture 7 Kinesis Firehose C# API class
Lecture 8 Kinesis Firehose C# API send data example
Section 5: AWS Glue, Athena, ETL jobs, Triggers, and using Hangfire
Lecture 9 Creating Glue Crawlers
Lecture 10 Query Data in Athena using SQL
Lecture 11 Creating AWS ETL jobs
Lecture 12 Hangfire - Automation
Section 6: AWS Lake Formation, Cognito and Parquet .NET
Lecture 13 AWS Lake Formation
Lecture 14 AWS Cognito
Lecture 15 Parquet .NET - Alternative to using Firehose
Section 7: Final thoughts and advice
Lecture 16 Conclusion
AWS developers interested in learning about building a data lake using AWS services and the AWS SDK.


Download link

rapidgator.net:
Citar
https://rapidgator.net/file/359e50a8e904bf48fa46ac9655a2182b/ashdq.Data.Lake.Firehose.Glue.Athena.S3.And.Aws.Sdk.For..Net.rar.html

uploadgig.com:
Citar
https://uploadgig.com/file/download/534f800Ba5Ff29c2/ashdq.Data.Lake.Firehose.Glue.Athena.S3.And.Aws.Sdk.For..Net.rar

nitroflare.com:
Citar
https://nitroflare.com/view/2168C37148CDE5B/ashdq.Data.Lake.Firehose.Glue.Athena.S3.And.Aws.Sdk.For..Net.rar

1dl.net:
Citar
https://1dl.net/r2ooyzke5p7j/ashdq.Data.Lake.Firehose.Glue.Athena.S3.And.Aws.Sdk.For..Net.rar.html