Traditional data engineering paradigms are increasingly finding their way into AI initiatives internally—the latest being data lineage as a subset of governance requirements. That’s posing a new challenge for companies.
@mattlynley
-
AI’s Cross-Disciplinary Challenge: From Data Engineers to MLEs
By
–
The challenge, though, is AI is increasingly cross-disciplinary and borrows skill sets from a lot of different roles. Lineage was traditionally a DE problem that’s now getting extended to MLEs/etc. and part is because the order for AI comes from on high.
-
Data Lineage in AI Models: Production Governance Requirements
By
–
Lineage basically means tracing data that went into a model/prompt, another part of a system coming together as we start to move into a prod phase. And AI is just a story about data moving around. It isn’t just about making sure an app breaks or whiffs governance requirements.
-
AI Data Lineage: Revisiting Pipeline Tracking Challenges
By
–
Let’s talk about a new (old) paradigm (or headache) emerging in AI: lineage. Yup, that lineage that we all dealt with back after it turned out just blindly putting together airflow pipes wasn’t the best idea and we needed to track data. And it turns out with AI, everything old
-
Why Google Uses Per-1K Character Pricing Model
By
–
I’m still kind of confused as to why google sticks to this per 1k character pricing, has anyone seen a good explanation why
-
Using AI Hints Effectively for Learning Complex Problem-Solving
By
–
I have actually had somewhat good success with this asking for hints on problems where I get stuck when revisiting old subjects (particularly proofs). Don’t ask for solution just explain where I’m stuck in the logic. YMMV extremely but when it works it’s pretty cool.
-
Mistral Model Impact Wave in AI Development
By
–
(though to be clear I doubt it was *just* the Mistral model and maybe more of a pending wave)
-
Technique AI Previously Documented Now Gaining Recognition
By
–
While I'm bummed I didn't get pre-briefed on a bunch of stuff pretty happy that there's a whole lot of "oh yeah I wrote about people using this technique X months ago" that's happening this morning lol
-
Evaluating Google’s Titan and PaLM Embeddings with MTEB Benchmarks
By
–
Here I am trying to figure out how I can get MTEB scores for Titan and PaLM embeddings and doing GPU hour math and I'm not cool enough to get a technical report for a Big Boy Model from Google.
-
Gemini Model Card Analysis Delayed by Jury Duty
By
–
Still reading through the model card/report on Gemini (which I did not make the pre-brief cut for this one, alas) so issue will be coming later due to getting called in for jury duty yesterday!