In conclusion, it looks like a neat architecture to pre-train GNNs. Learnable prompts are a handy addition and might re-appear in future architectures. Can't wait to become a graph prompt engineer.
INNOVATION
-
Big Tech’s LLM Delay: OpenAI’s Market Catalyst Effect
By
–
well, exhibit A is the fact that none of the big tech cos shipped LLMs until OpenAI pushed them out of slumber
-
Learnable Prompts Enable Better Task-Specific Knowledge Extraction
By
–
Learnable prompts provide a better alternative to handcrafted prompts, and enable the extraction of the most relevant prior knowledge for each task. The prompts are a dimension-wise reweighting (or a linear transformation) of the node representations.
-
Big Tech Lacks Genuine Commitment and Early Confidence
By
–
the “earnestly” rarely exists at the big tech company far too much self doubt and defeatism far too early
-
Graph Neural Networks Pre-training with Link Prediction Task
By
–
During pre-training, the GNN is trained on a link prediction task. By sampling nodes and forming triplets, a pre-training loss is constructed that improves the similarity between the contextual subgraphs of two candidate nodes.
-
GraphPrompt: Unified Pre-Training Framework for Graph Neural Networks
By
–
GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks Interesting pre-training training framework for GNNs, based on learnable prompts. It reduces labeling needs and boosts downstream task performance. https://
arxiv.org/abs/2302.08043 -
Tech Giants’ Political Culture Wastes Engineering Talent
By
–
there are so many engineers (literally 10s of thousands) at big tech companies who are working on things that fundamentally don't matter and nobody cares about this is because at "the top", there's politics where it's better to be nice vs right, and deep inefficiency persists
-
Immune Engineering: CAR-T and Genomics Revolutionize Disease Treatment
By
–
“I’ve become convinced that immune engineering is one of the most promising frontiers for the application of the 4-S stack.” A brilliant one on CAR-T, genomics, and engineering immune cells to cure every disease. https://
open.substack.com/pub/centuryofb
io/p/immune-engineering
… -
Tenstorrent Hosts Scalable RISC-V Design Event in Raleigh
By
–
Join us this week in Raleigh, NC for two days to talk about our scalable #riscv design. Sign up here –> http://
bit.ly/riscvnc #meetandgreet #riscvdesign #tenstorrent -
Google OSS Receives Strong Community Goodwill Support
By
–
And a lot of goodwill from the community. @GoogleOSS