when my code is getting too slow, i just run it a couple times and ctrl-C on the slow part, see where in my code it stops me. i call it the poor man's profiler
@jxmnop
-
Explaining Machine Learning Concepts to Your Grandma
By
–
what are some ideas from machine learning that i can explain to my grandma?
-
32k Models Discussion and Model Capability Limitations
By
–
don't think you should get to work on that because there are a few 32k models in the replies here
-
ICLR Acceptance Decisions and Research Community Reflections
By
–
in light of ICLR acceptance decisions yesterday, here's a little reminder from robin williams
-
Set-Based Language Models Without Positional Embeddings
By
–
actually I don't need anything with positional embeddings since i'm doing something weird, i just realized this, my objective is 'set based' so there's no ordering. so really i guess i could use most LMs with positional encoding disabled?
-
Anchor Points Problem in Machine Learning Initialization Methods
By
–
how would you do it? check this out: http://
arxiv.org/abs/2303.00721 even these people need 15 or so "starting" anchor points, which i consider cheating in my problem setting -
Long Context Encoder Models and Token Processing Optimization Techniques
By
–
anyone know a model that’s out there that’s encoder-only (BERT-like) but supports a really long context length? also what's the most efficient way of processing many tokens like this? i know about enabling FlashAttention & BetterTransformer. what else is out there?
-
Unsupervised Bilingual Word Embeddings Mapping Technique
By
–
yep i mentioned this!! This is my inspiration (specifically unsupervised mapping of bilingual word embeddings)
-
Unsupervised Text Embedding Space Alignment Research Problem
By
–
As an exercise in open science, gonna tweet the research problem I’m stuck on: i want to align two text embedding spaces in an unsupervised way. The motivation is that in my previous vec2text work, we have to know the embedding model and be able to query it. this is fine in
-
Random Seed Reset Issue During Model Training Epochs
By
–
every configuration of hyperparameters does this haha. i'm thinking maybe it resets the random seed every epoch? or somehow is shuffling poorly?