Unlike existing techniques – this method requires no additional fine tuning. By setting a few parameters in your HuggingFace config.json, you can instantly extend the performance of ALiBi models such as BTLM-3B-8K by ~2x: https://
huggingface.co/cerebras/btlm-
3b-8k-base#during-inference-without-fine-tuning
…
INNOVATION
-

ALiBi Models Performance Extension Without Fine-Tuning
By
–
-
ALiBi Context Extrapolation Limits in Production Language Models
By
–
ALiBi promises fast, long extrapolation but in production models only extrapolate 10-20% longer than its training context. This is why ALiBi models such as BTLM-3B-8K and MPT-7B-8K are trained on a mix of 2K and 8K contexts – ALiBi on its own cannot extrapolate from 2K to 8K.
-
Position Interpolation Doubles Context Length for ALiBi Models
By
–
Paper drop: Position Interpolation Improves ALiBi Extrapolation We found a simple method to 2x the context length of models that use ALiBi. This lets models like BTLM-3B-8K and MPT-7B-8K run high quality inference at up to 16K with no additional fine tuning.
-
Dream Gaussian Image-to-3D Model Now Available on Replicate
By
–
Image-to-3D model Dream Gaussian is now on Replicate.https://t.co/NcOHwxM6nj pic.twitter.com/UAoRy8OIp8
— Replicate (@replicate) 23 octobre 2023Image-to-3D model Dream Gaussian is now on Replicate. https://
replicate.com/alaradirik/dre
amgaussian
… -

Quality-Diversity AI Feedback Method Research Advances
By
–
Quality-Diversity through AI Feedback Bradley et al.: https://
arxiv.org/abs/2310.13032 #ArtificialIntelligence #DeepLearning #MachineLearning -
China AI chip sanctions may fork AI technique development
By
–
Currently, we overfit to exploring AI techniques that work well on NVIDIA GPUs.
With the AI Accelerator sanctions on China — one interesting result might be that China forks silicon and explores a different idea-space in AI techniques than the rest of the world. -

AI Healthcare Startups Transforming Medical Workflows at HLTH
By
–
We are charging healthcare one workflow at a time with #AI at @AutonomizeAI – check out this blog from @NVIDIA on what's cooking in healthcare at @HLTHEVENT https://
linkedin.com/pulse/20-gen-a
i-healthcare-startups-shaping-future-recap-from-renee-yao-q7lkctrackingId=CDv6Q85cRDK9HLA4si2BlTg3D3D/?trackingId=CDv6Q85cRDK9HLA4silTg
… -
AI Transforming Healthcare Workflows at Autonomize
By
–
We are charging healthcare one workflow at a time with #AI at @AutonomizeAI – check out this blog from @NVIDIA on what's cooking in healthcare at @HLTHEVENT https://
linkedin.com/pulse/20-gen-a
i-healthcare-startups-shaping-future-recap-from-renee-yao-q7lkctrackingId=CDv6Q85cRDK9HLA4si2BlTg3D3D/?trackingId=CDv6Q85cRDK9HLA4silTg
… -
MIT Air-Guardian: AI Enhances Aviation Safety Without Replacing Humans
By
–
This is cool… an AI for safer skies: "the AI doesn't merely replace human judgment but complements it" MIT researchers developed Air-Guardian to reduce operational errors and make flying safer.
-

Untether AI Showcases 500 TOPS tsunAImi Acceleration Card
By
–
Visit us at #SC23 for a demo of our 1 chip, 500 TOPS #tsunAImi AI acceleration card, running a full-stack AI video analytics reference design featuring an instance segmentation neural network. See how Untether AI can maximize the performance of your #AI #inference workloads. #HPC