http://
cs.washington.edu/homes/pedrod/p
apers/iclr18.pdf
…
MACHINE LEARNING
-
Machine Learning Research Paper from University of Washington
By
–
-
Three Eras of Programming: From Assembly to AI
By
–
The three eras of programming:
1. Assembly code
2. High-level languages
3. AI -
GPT-3 Training Data Composition Breakdown
By
–
GPT-3 has been trained on 45 TB of text data from different categories: ⬩Common Crawl (8 years of raw web page crawling) ⬩WebText (The text of Reddit posts with 3+ upvotes) ⬩Books (The internet-based books corpora) ⬩Wikipedia Data is then "weighed" as such:
-
How AI Models Transform Input into Predictions
By
–
This means that it can take user's input text and transform it into what it predicts the most useful result will be based on the patterns recognized from the parameter library.
-
How Language Models Function as Probabilistic Text Predictors
By
–
When a user provides the text input, the system analyzes the language and uses a text predictor to create the most likely* output. *Does not necessarily mean the most factually accurate output, but rather the most "likely" output based on the data from the training library.
-
Understanding Parameters in AI Models Like GPT-3
By
–
GPT-3 has a lot of "parameters" for guessing the next words in a sequence. What's a parameter? It's a variable within the model whose value can be estimated from the given data. They are required by the model when making predictions. GPT-3 has about 175,000,000,000 of them.
-
How AI Models Learn to Recognize Textual Patterns
By
–
The algorithm (or "model") utilizes a set of data that enables it to recognize certain patterns in the text. This is accomplished by training the system on the vast body of internet text to spot patterns.
-
CICERO by Meta AI: Strategic Dialogue Generation System
By
–
#CICERObyMetaAI generates strategic, free-form dialogue by: Predicting the moves other players are likely to make Creating a plan based on those predictions Generating messages Filtering the final messages for clarity and value Read more on our blog
-
ACM Gordon Bell Prize Awarded for HPC COVID-19 Research
By
–
Congratulations to our Solutions Engineers, Claire Zhang and Cindy Catherine Orozco Bohorquez, who recently received their ACM Gordon Bell Special Prize for HPC-Based COVID-19 Research awards! Read the paper here: https://
hubs.li/Q01s_n7N0 -
Old NLP Experts Underestimate Language Models’ Capabilities
By
–
Some old-time NLPers can be closed minded about the "range of tasks" that LMs can do. They are still thinking about LMs through BERT, etc. I rarely see this issue with new-joiners to NLP.