* Cantinho Satkeys

Refresh History
  • FELISCUNHA: ghyt74  pessoal  49E09B4F
    11 de Setembro de 2026, 11:37
  • JP: try65hytr Pessoal  4tj97u<z 2dgh8i k7y8j0 classic
    11 de Setembro de 2026, 05:33
  • JP: try65hytr Pessoal k7y8j0 2dgh8i k7y8j0 yu7gh8
    08 de Setembro de 2026, 04:15
  • j.s.: dgtgtr a todos  49E09B4F 49E09B4F
    06 de Setembro de 2026, 12:15
  • FELISCUNHA: Votos de um santo domingo para todo o auditório  k8h9m
    06 de Setembro de 2026, 12:02
  • JP: try65hytr Pessoal 4tj97u<z 2dgh8i k7y8j0 r4v8p
    04 de Setembro de 2026, 04:35
  • FELISCUNHA: ghyt74  pessoal   49E09B4F
    03 de Setembro de 2026, 08:38
  • JP: try65hytr Pessoal 4tj97u<z 2dgh8i k7y8j0 yu7gh8
    01 de Setembro de 2026, 04:12
  • j.s.: try65hytr a todos  49E09B4F
    31 de Agosto de 2026, 20:33
  • FELISCUNHA: ghyt74  pessoal   49E09B4F
    26 de Agosto de 2026, 10:51
  • JP: try65hytr Pessoal 4tj97u<z 2dgh8i k7y8j0 classic
    25 de Agosto de 2026, 04:05
  • FELISCUNHA: ghyt74  pessoal   49E09B4F
    21 de Agosto de 2026, 11:28
  • JP: try65hytr Pessoal 4tj97u<z 2dgh8i k7y8j0 classic
    21 de Agosto de 2026, 05:22
  • JP: try65hytr Pessoal 4tj97u<z 2dgh8i k7y8j0 43e5r6
    17 de Agosto de 2026, 04:09
  • j.s.: dgtgtr a todos  49E09B4F
    15 de Agosto de 2026, 15:07
  • FELISCUNHA: ghyt74   49E09B4F  e bom fim de semana  4tj97u<z
    15 de Agosto de 2026, 11:45
  • Alberto: Revistas
    15 de Agosto de 2026, 05:32
  • JP: try65hytr Pessoal 4tj97u<z 2dgh8i k7y8j0
    14 de Agosto de 2026, 05:05
  • j.s.: try65hytr try65hytr a todos  49E09B4F 49E09B4F
    11 de Agosto de 2026, 20:26
  • JP: try65hytr Pessoal 2dgh8i k7y8j0 r4v8p
    11 de Agosto de 2026, 04:30

Autor Tópico: Testing LLMs With DeepEval, Promptfoo, RAG & CI/CD  (Lida 5 vezes)

0 Membros e 1 Visitante estão a ver este tópico.

Online WAREZBLOG

  • Moderador Global
  • ***
  • Mensagens: 19396
  • Karma: +0/-0
Testing LLMs With DeepEval, Promptfoo, RAG & CI/CD
« em: 09 de Setembro de 2026, 21:41 »

Testing LLMs  With DeepEval, Promptfoo, RAG & CI/CD
Published 9/2026
Created by Madhulika Mitra
MP4 | Video: h264, 1920x1080 | Audio: AAC, 44.1 KHz, 2 Ch
Level: Intermediate | Genre: eLearning | Language: English | Duration: 23 Lectures ( 3h 59m ) | Size: 2 GB

Evaluate RAG apps, red-team for security, and automate quality gates in CI/CD - become job-ready in AI QA
What you'll learn
⚡ Explain why unit, integration, and E2E tests are not enough for generative AI
⚡ Test RAG end to end - retrieval quality and grounded generation along with agentic multi flow testing
⚡ Deepeval evaluation metrics , Promptfoo security testing
⚡ Put evaluations in CI/CD with thresholds, quality gates, and cost control
Requirements
❗ Python programming expertise and Testing fundamentals
Description
AI/LLM Testing Mastery: From DeepEval to Production CI/CD
Traditional tests can be green while your chatbot is still wrong, biased, or jailbroken. This course teaches you how to test LLM applications the way production teams actually have to: with metrics, judges, adversarial checks, and quality gates.
You will learn to evaluate correctness, relevance, faithfulness, hallucination, toxicity, bias, and security. You will test RAG pipelines and AI agents, run prompt-injection and jailbreak cases, and wire the whole suite into GitHub Actions so a bad answer can block a deploy.
We use DeepEval and Promptfoo, local models with Ollama (no API key required to learn), and finish with a portfolio-ready capstone: a support chatbot, an evaluation suite, and a CI pipeline.
You will learn how to
✨ Explain why unit, integration, and E2E tests are not enough for generative AI
✨ Score free-form answers with LLM-as-judge instead of exact string matches
✨ Test RAG end to end - retrieval quality and grounded generation
✨ Test tool selection, multi-step agents, and memory
✨ Red-team chatbots for injection, jailbreaks, and data leaks
✨ Put evaluations in CI/CD with thresholds, quality gates, and cost control
✨ Debug a failing eval: was the chatbot wrong, or was the judge wrong?
Includes hands-on labs, homework after each module, and a GitHub project.
Who this course is for
⭐ QA engineers, SDETs, and testers moving into AI quality roles
Homepage
Código: [Seleccione]
https://www.udemy.com/course/testing-llms-with-deepeval-promptfoo-rag-cicd
Recommend Download Link Hight Speed | Please Say Thanks Keep Topic Live
No Password  - Links are Interchangeable