following up on some repos from the stream (sorry for delay, merely got lazy) – @yikesawjeez https://
github.com/swyxio/devin-d
ocker-ui/
…
– @studentfoundersclub https://
github.com/swyxio/devin-c
loudflare-upload/
…
– building a @temporalio workflow by reading docs and setting up a local cluster (cant remb who asked for this)
TOOLS
-
Following Up on Stream Repos and Temporal Workflow Setup
By
–
-
Choosing Slower Best Models for API Integration in Production
By
–
When building products against APIs – in personal use I still stick to the best available but slowest model for almost everything
-
OpenAI Launches Batch Processing for Workflow Automation
By
–
OpenAI is finally getting into batch data processing, which it turns out is where a lot of actual usage is/will be! Boring, but lots of value in point automation in workflows in the near term. No mythical agents replacing teams, alas!
-
Unified AI API Services vs Data Privacy Trade-offs
By
–
Advantage here obviously is you're buying one service and get all the APIs—text-to-image/voice, chat completion, etc. But at the same time it's still an API shipping off data vs keeping it where it's hosted. Now they're dealing w/ Snowflake/Databricks on top of other startups.
-
Choosing AI Models: Speed Cost Trade-offs Beyond Haiku
By
–
For when I'm building user-facing features where speed and cost are important but Haiku isn't quite cutting it
-
OpenAI Batch API: Production-Ready Data Processing Solution
By
–
Some notes on the OpenAI batch API. Kind of a better-late-than-never adaptation to what most of the "AI in prod" cases actually look like, which is batch data processing for classic problems like summarization, classification, etc. I talked about this in last Friday's issue.
-
Automate Enterprise Workflows with Cohere Command R+
By
–
Automate your enterprise workflows with Cohere's multi-step tool use. Our generative model Command R+ excels at leveraging external tools to execute complex tasks to streamline business operations. Get started today!
-
API Billing Limits: Enterprise-Only Monthly Spending Controls
By
–
For a wonderful moment I thought this might let me issue an API key that can only spend a max of x dollars a day, so I can finally ship demos for people to try out without risk of over-spending
— Simon Willison (@simonw) 16 avril 2024
Sadly not: billing limits are per month, and are currently "enterprise only" https://t.co/Pga5JnhYIDFor a wonderful moment I thought this might let me issue an API key that can only spend a max of x dollars a day, so I can finally ship demos for people to try out without risk of over-spending Sadly not: billing limits are per month, and are currently "enterprise only"
-
Balancing Model Performance and Latency for User-Facing Features
By
–
I'm considering it for user-facing features where latency performance is important but Haiku isn't quite giving me good enough results
-
Choosing Between Opus and GPT-4 for Production Features
By
–
For my own personal use, I tend to stick with the best available model, so Opus or GPT-4 But now that I'm building user-facing features on them both cost and speed are more important, so I'm being more thoughtful about which model to use