And it's particularly galling in natural language processing because our biggest platform (the ACL Anthology) is open access.
RESEARCH
-
arXiv Overwhelmed by CS and ML Communities Explosion
By
–
It sounds like arXiv is/was fine in its original use cases, but has become a monster in CS, especially ML/AI (and everyone who is impacted by them). I'm guessing that's a combination of size of community, scientific norms, and commercial/VC interest.
-
AI fails to write ‘2+2=’ on chalkboard and scrolling text
By
–
Tried one with realistic “2 + 2 =” on a chalkboard but couldn’t get the hand to write anything in three attempts. I did another example with upward-scrolling text that also didn’t work.
-
Axelera AI Presents Digital Compute-in-Memory for Vision
By
–
Check out our Head of Machine Learning, Bram Verhoef, in his presentation at the @edgeaivision – Embedded Vision Summit 2024 last May, where he talks about How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-efficient Computer Vision.
-

MixEval Benchmark: Evaluating General-Purpose Chatbot Performance
By
–
Next time you pick benchmarks for model evaluation, check this correlation matrix from the MixEval paper. It's a great proxy for @lmsysorg Chatbot Arena performance, perfect for general-purpose chatbots. MixEval: https://
mixeval.github.io -
ArXiv vs Peer Review: Integrity in AI Research Citation
By
–
Citing arXiv versions **instead of** peer reviewed versions of the same paper undermines and devalues peer review, and gives the impression that arXiv in general is a good source. More here: https://
medium.com/@emilymenonben
der/scholarship-should-be-open-inclusive-and-slow-15ab6ce1d74c
… -
Understanding Online Misinformation: Research Gaps and Information Ecosystems
By
–
¿Qué sabemos sobre #desinformación online?
Tendemos a exagerar el alcance de los estudios, interpretar mal sus resultados, llegar a juicios apresurados…
Necesitamos más investigación para entender los ecosistemas de información.
Con @lageneralista -
Scaling Laws and Inference Cost Reduction: Independent Statements Clarified
By
–
That’s inaccurate. I made two independent statements : 1) power of scaling law, 2) inference cost will drop 100x in the next two years. There is no causal relationship between the two points. @tsarnick
-

Fine-tuning and Model Merging at AI Engineer World’s Fair
By
–
Hey, I'll be speaking at the AI Engineer World's Fair (
@aiDotEngineer
) in SF on June 26. We'll discuss fine-tuning and model merging in concrete terms, with notebooks and examples. -
Reductionism in AI Cultural Impact Analogies
By
–
The paper focuses on the negative consequences, which somehow feels more appropriate to draw analogies. The jump to most cultural products I feel uncomfortable with. Both are reductionist; one is a useful comparison, the other seems insulting…