GPT-3 has 175 billion parameters (synapses). Human brain has 100+ trillion synapses. In 2020, it costs ~$2.6 billion to train neural net the size of the human brain. If ML training efficiency improvement trends continue, in 2040, it'll cost $80,000. Video: https://t.co/pVKbPxnbRy
— Lex Fridman (@lexfridman) August 3, 2020
from Twitter https://twitter.com/lexfridman
August 03, 2020 at 09:45AM
via IFTTT
No comments:
Post a Comment