GPT-2 is a language model that was trained on 40GB of text scraped from websites that Reddit linked to and that had a Karma score of at least two. As the developers at OpenAI describe it, GPT-2 is "a large-scale unsupervised language model which generates coherent paragraphs of text, achieves state-of-the-art performance on many language modeling benchmarks, and performs rudimentary reading comprehension, machine translation, question answering, and summarization—all without task-specific training." Because the model is probabilistic, it returns a different response every time you enter the same input.
OpenAI decided not to release the 40GB-trained model, due to "concerns about malicious applications of the technology" but it released a 345MB-trained model which you can install as a Python program and run from a command line. (The installation instructions are in the DEVELOPERS.md file.) I installed it and was blown away by the human-quality outputs it gave to my text prompts. Here's an example - I prompted it with the first paragraph of Kafka's The Metamorphosis. And this is just with the tiny 345MB model. OpenAI published a story that the 40G GPT-2 wrote about unicorns, which shows how well the model performs.
In this Computerphile video, Rob Miles of the University of Nottingham explains how GPT-2 works.
Our pal Andy Baio has been experimenting with an audio separation library called spleeter “that uses machine learning to quickly and freely separate music into stems.” It does a surprisingly good job, and he is using it to make funny mashups: nobody should have this kind of power pic.twitter.com/4vbl2MGK4Z — Andy Baio (@waxpancake) November 5, […]
Sue-Lin Wong is the Financial Times's South China reporter; this week, she attended the China Public Security expo, the country's largest surveillance tech show, held biannually in Shenzhen.
"Affordances" is my new science fiction story for Slate/ASU's Future Tense project; it's a tale exploring my theory of "the shitty technology adoption curve," in which terrible technological ideas are first imposed on poor and powerless people, and then refined and normalized until they are spread over all the rest of us.
Got some aches that a lazy rubdown won’t put a dent in? Give your muscles an early Christmas with these massage guns. If you’ve never tried one, they’re all designed to bring deep tissue relief, and they’re all at Black Friday prices now. JAWKU Muscle Blaster V2 Cordless Percussion Massage Gun This cordless massager exerts […]
Just about everybody from small-time app developers to big database administrators loves Linux. But just because it’s open-source doesn’t mean its secrets are open to everybody. For that, you need a comprehensive training program like the Complete Linux System Administrator Bundle. If you’re chasing any kind of career in coding, this is the online regimen […]
If you want to be an app developer for Android, there’s never been a better time. Languages like Kotlin are tailor-made for functionality, and the Jetpack suite of tools makes the whole process easier. The only hurdle is learning your way around these tools, and that’s where the Android Jetpack & App Development Certification Bundle […]