actually I don't need anything with positional embeddings since i'm doing something weird, i just realized this, my objective is 'set based' so there's no ordering. so really i guess i could use most LMs with positional encoding disabled?
TECHNOLOGY
-
Long Context Encoder Models and Token Processing Optimization Techniques
By
–
anyone know a model that’s out there that’s encoder-only (BERT-like) but supports a really long context length? also what's the most efficient way of processing many tokens like this? i know about enabling FlashAttention & BetterTransformer. what else is out there?
-
Samsung Galaxy S24 Debuts Real-Time Call Translation AI
By
–
Happening now: Samsung’s #SamsungUnpacked event for the debut of the Galaxy S24. Expect lots of new AI features to be announced. One new feature: The S24 will have real-time language translations for calls & IRL convos with two-way text & voice translations.
-
Google Quantum AI Lab: Art Meets Innovation in Santa Barbara
By
–
The Google Quantum AI team embraces the intersection between art & science, as seen in their quantum computing labs in Santa Barbara, CA. Check out @NewsHour’s walk-through of this space, where art brings the lab to life and inspires innovation →https://t.co/ZIqiT48OOI pic.twitter.com/wKs2aXewQP
— Google AI (@GoogleAI) 17 janvier 2024The Google Quantum AI team embraces the intersection between art & science, as seen in their quantum computing labs in Santa Barbara, CA. Check out @NewsHour
’s walk-through of this space, where art brings the lab to life and inspires innovation →
https://
goo.gle/47CNhZS -
AlphaGeometry Solves 25 Olympiad Geometry Problems at Human Level
By
–
“AlphaGeometry solved 25 within the standard Olympiad time limit. For comparison, the previous state-of-the-art system solved 10 of these geometry problems, and the average human gold medalist solved 25.9 problems.”
-
Live Discussion on Internet Future with Steven Johnson
By
–
For anyone who pre-orders Read Write Own: you are invited to a live discussion between me and @stevenbjohnson
, author of 13 books and a writer I really admire, on Jan 24th. We’ll discuss the future of the internet and much more. If you already pre-ordered, you’re invited as well -
AI Revolutionizing Plant Health Monitoring in Agriculture
By
–
AI Wednesday: Revolutionizing Plant Health Monitoring with AI https://
linkedin.com/pulse/ai-wedne
sday-revolutionizing-plant-health-monitoring-nicolas-babin-02ede
…
#artificalintelligence #agritech #plant #innovation #technology @PawlowskiMario @Fabriziobustama @jblefevre60 @pierrepinna @IsabellePiel29 @thierry_pires @3itcom @enilev @RagusoSergio @baski_LA -
High School Diplomas Now Available in Metaverse Environments
By
–
#Metaverse https://
dexerto.com/tech/students-
can-now-attend-a-high-school-in-the-metaverse-and-earn-real-world-diplomas-2480790/
… -
CES 2026 Drives Market Optimism Despite Bitcoin ETF Pullback
By
–
The TL Podcast for January 15th: CES brings the animal spirits The annual gadget fest in Las Vegas, The Consumer Electronics show, contributed to an upbeat week for stocks, but spot ETFs of Bitcoin were a sell-on-the-news event. https://
thetechnologyletter.com/the-posts/the-
tl-podcast-for-january-15th-ces-brings-the-animal-spirits
… Or catch it on Apple -
Next.js Documentation Enhancement Makes MDX Implementation Nearly Unrecognizable
By
–
Yes, they are. They managed to enhance it so good that it's almost unrecognizable as .mdx. https://
github.com/vercel/next.js
/tree/canary/docs
…