I like free hosting, because then it doesn't blink out of existence if a credit card expires GitHub Pages looks like a fantastic option for that these days
CODE
-
Fine-tuning Embedding Models: Why BERT Outperforms Larger T5 Encoders
By
–
question: i’m finetuning embedding models for a retrieval. i found large T5 encoders from GTR and SentenceT5 families significantly underperform BERT base how is this possible? feels it must be hyperparameters? unless i found the one NLP task ever where scaling doesn’t help
-
Technical Communication Skills Essential for Career Advancement
By
–
But as a candidate you can still greatly improve your chances by putting out public evidence that you can do the work – and clear technical communication is very much a part of the job, especially as you grow into more senior levels
-
Software Systems Design: Beyond Explicit Function Engineering
By
–
I think many people are used to thinking of software systems as something where all the functions are explicitly designed.
-
Llama timeout issues resolved with Mistral model
By
–
I know I was running into the same issue; llama requests time out pretty fast. I had to use the mistral model.
-
Copilot’s Impact on Coding Productivity Measured
By
–
Field experiments are great but they can go wrong in so many ways because the real world is messy I appreciate this honest write-up of the difficulties of measuring the impact of Copilot on coding performance. It looks like it lifted productivity, though. https://
mit-genai.pubpub.org/pub/v5iixksv/r
elease/2?readingCollection=7e70f4fe
… -
Combining DDP, bf16, gradcache and accelerate techniques
By
–
lol kind of. it was nontrivial for me to combine DDP, bf16, gradcache, and accelerate. maybe we could work together
-
GradCache Optimization for Distributed GPU Training
By
–
oh yeah. I think his trick was just GradCache. and sharing negatives between GPUs isn’t trivial
-
Framework Features Beyond PyTorch Lightning Trainer
By
–
what would u expect from this kind of framework that u don’t get from eg pytorch lightning trainer?
-
Snorkel Flow Launches PDF Prompting UI for Document Intelligence
By
–
New Snorkel Flow feature alert! Prompt your PDFs Snorkel Flow now offers a dedicated prompting UI making it easier to annotate PDF data programmatically using the latest FMs. Learn more about the new FM Document Intelligence powered workflow. https://
buff.ly/4aQoqUO