We are open-sourcing the models and the evaluation datasets and performance experiments. Git repository: https://
github.com/abacusai/Long-
Context
…. You can use the model directly from HuggingFace. 4k version: https://
huggingface.co/abacusai/Giraf
fe-v1-delta-13b-scaled-4
…. 16k version: https://
huggingface.co/abacusai/Giraf
fe-v1-delta-13b-scaled-16
….
AI
-
Abacus AI Open-Sources Giraffe Long-Context Models
By
–
-
ReLoRA Paper: Exploring LoRA for LLM Pretraining Beyond Finetuning
By
–
Just catching up with the ReLoRA paper (
https://
arxiv.org/abs/2307.05695) that explores whether LoRA can be used for pretraining LLMs (vs finetuning). Looks promising! Caveat: they pretrained models up to 350 M parameters (the smallest Llama model is 7 B parameters, for comparison) -
CISOs Combat Rising Cyber Threats with Budget Optimization
By
–
How can #CISOs combat rising cyber threats with varying budgets? NCC Group's analysis reveals effective strategies to adapt and optimize #cybersecurityinvestments, safeguarding organizations from potential risks. https://
ow.ly/MQIE50PvVQu #sponsored #ncc_iiot @NCCGroupplc @mclynd -
Optimizing Human Interactions for Happiness and Success
By
–
All aspects of human interactions should be continuously nurtured, improved, and optimized for achieving and maintaining happiness, joy, and success.
-
Life Optimization Encompasses All Human Interactions
By
–
Life optimization includes all aspects of human interactions.
-
Analytics Critical for Nonprofit Organization Success and Growth
By
–
Just how important are #analytics to nonprofit organizations? “Very!” Chris Williams, CTO at @llc_pag,discusses the position analytic analysis holds in elevating nonprofit organizations.
— Alteryx (@alteryx) 9 août 2023
👂 Tune into #AlteryxAlterEverything: https://t.co/ybG5TwkBf9#AlteryxForGood pic.twitter.com/tFvnNtRyhjJust how important are #analytics to nonprofit organizations? “Very!” Chris Williams, CTO at @llc_pag
,discusses the position analytic analysis holds in elevating nonprofit organizations. Tune into #AlteryxAlterEverything: https://
ow.ly/93qw50PuwgW #AlteryxForGood -
Outlook iOS AI Email Response Nudging Feature
By
–
so Outlook on iOS has started nudging me to answer emails now
-
Runway ML Launches Suburban Nights Free Footage Pack
By
–
Flickering street lights. A warm gentle breeze. And a reckless sense of abandon.
— Runway (@runwayml) 9 août 2023
Introducing the Suburban Nights Footage Pack. Download free at https://t.co/pQCpPEat2G pic.twitter.com/52OCZbHKXQFlickering street lights. A warm gentle breeze. And a reckless sense of abandon. Introducing the Suburban Nights Footage Pack. Download free at http://
runwayml.com/footage-packs -
AI answers biased by left-leaning online text training data
By
–
The AI’s answers are purely a result of the training data it ingests (and tech companies aren’t specific about what was precisely included in the training corpus) You could argue that a preponderance of online text is slightly left-leaning, as those who are compelled to write
-
Removing dataset to ensure fair neural network method comparison
By
–
Thanks. And yeah, good call removing that dataset because especially NN methods would have an unfair advantage there