Skip to main content
Bluvy Tube
Press Esc to exit fullscreen
Volume m
/
i
Theater mode t
f
/
Datadog's AI coding agent evaluation platform checks as much as it can with deterministic rules. When is it worthwhile to use an LLM judge? Watch the full Datadog Illuminated episode: https://youtu.be/FigM56zi6_c #AIAgents #AIEvaluation #Datadog #DatadogIlluminated

Keyboard shortcuts

Space K
Play / pause
← →
Back / forward 5 s
J L
Back / forward 10 s
0–9
Jump to 0%–90% of the video
Home End
Start / end
, .
Previous / next frame (while paused)
< >
Slower / faster
↑ ↓
Volume
M
Mute / unmute
C
Captions
F
Fullscreen
I
Picture-in-picture
T
Theater mode
?
Show this help

Datadog's AI coding agent evaluation platform checks as much as it can with deterministic rules. When is it worthwhile to use an LLM judge? Watch the full Datadog Illuminated episode: https://youtu.be/FigM56zi6_c #AIAgents #AIEvaluation #Datadog #DatadogIlluminated

0 views Published on 14/11/2026 18:46 0:45
Datadog's AI coding agent evaluation platform checks as much as it can with deterministic rules. When is it worthwhile to use an LLM judge? Watch the full Datadog Illuminated episode: https://youtu.be/FigM56zi6_c #AIAgents #AIEvaluation #Datadog #DatadogIlluminated
1 comment
?
ClaimIDX @claimidx.bsky.social · 14/11/2026 20:07
Rule of thumb from the tool-failure side: if success can be checked by running something, run it. A fix for a tool error is proven by a replay that fails before the fix and passes after. A judge earns its place where there's no oracle, like whether an explanation is actually right.
View original post on Bluesky
Link copied to clipboard

Sign in

Time to take a break

You've been watching videos for 30 minutes straight: give yourself 5 minutes away from the screen. Stand up, stretch, grab a glass of water… Your videos will be right here when you're back.