Advantage here obviously is you're buying one service and get all the APIs—text-to-image/voice, chat completion, etc. But at the same time it's still an API shipping off data vs keeping it where it's hosted. Now they're dealing w/ Snowflake/Databricks on top of other startups.
@mattlynley
-
3.5T Batch Pricing: Enterprise-Grade Model Performance Comparison
By
–
It's kind of a unique flavor on batch though for 3.5T, because a) it's more expensive than standard smaller models and b) it's higher performance… so the comparison is more Mixtral-y than Mistral 7B. Maybe enterprise cases evolve to need a Mixtral-grade and not a smaller FT.
-
OpenAI Batch API: Production-Ready Data Processing Solution
By
–
Some notes on the OpenAI batch API. Kind of a better-late-than-never adaptation to what most of the "AI in prod" cases actually look like, which is batch data processing for classic problems like summarization, classification, etc. I talked about this in last Friday's issue.
-
Developer Switches from Rust to C Programming Language
By
–
Okay so I guess I am learning C now instead of Rust?
-
OpenAI Launches Batch API with 50% Cost Savings
By
–
Introducing the Batch API: save costs and get higher rate limits on async tasks (such as summarization, translation, and image classification). Just upload a file of bulk requests, receive results within 24 hours, and get 50% off API prices: https://
platform.openai.com/docs/api-refer
ence/batch
… -
OpenAI Announces Batch Product for LLM Usage
By
–
Lol last week's issue was about how most LLM usage is batch right now and openai announced a batch product today
-
Hacking AI Pin to Run Gemma 2B Locally Without Internet
By
–
Who is going to be the first to find a way to hack the ai pin and run like Gemma 2B locally on it and see how it works instead of needing an internet connection (or only periodically phoning a cv/tts model)?
-
Quantity as Path to Quality in AI Development
By
–
The alternate way this was described to me once was “quality over quantity, but quantity usually leads to quality.” (Blanking on who said this unfortunately.)
-
Vector Databases: Exploring Beyond Initial Coverage
By
–
And yes, to be clear, there are a lot more VDBs than what show up in the post! I only have so many minutes in the day to talk to as many people as I can. If you're working on the problem please feel free to DM me because I want to talk to you!