GPT-2 is Open AI's language-generation model (last seen around these parts as a means of detecting machine-generated text); it's powerful and cool, and Gwern Branwen fed it the Project Gutenberg poetry corpus to see what kind of poetry it would write.
Pretty good poetry, as it turns out.
Scott Alexander (previously) does a good job of highlighting its greatest hits (and misses).
GPT-2 poetry manages some impressive accomplishments, like solid iambic pentameter ("Thou know’st how Menoetiades the swift/Was dragged, of Hector and the fierce compeers/And Phrygian warriors. So, we will dispatch/Your bodies, then, yourselves to burn the ships/In sacrifice; with torches and with bells") though it struggles with extended/complex rhyming ("If sick of sense; Wholubil, or snug. ills, we know our own our first in sense the worse maintained between the worse, soon expired").
Sometimes, it gets stuck (there's a poem that's just "The Emperor Wu (the great Wu), majestical," repeated 11 times, then a bunch of repetitions of "The Emperor Wu (the great Wu), rapacious," salted with the odd "majestical"), but some of it is actually gorgeous:
There are several kinds of people in America;
There are several kinds of people, I mean their number.
There’s a girl growing up in the house by the light,
There’s a youth upon the road, or a girl somewhere in New York;
There’s a prettier girl, and a man more congenial,
But none of the likes of the likes of the fellows are equal.
There’s one who has never been married and married,
There’s one who don’t want to be treated with kindness;
A fair youth is never employed nor neglected;
There’s one who has never yet come to a neighbor,v
And one who resides in New York from the start;
But none of the likes of the likes of the fellows
Are equal to him, and wherever he goes,
The heart somehow breaks under the hand that is steering;
And so it is with me
As with a lot of machine-learning applications, I suspect that this one would be best served as the basis for a centaur, with the model churning out tons of poetry and a human acting as a discerner to throw away the garbage and pluck out the happy accidents.
Finetuning the GPT-2-small Transformer for English Poetry Generation [Gwern Branwen/Gwern.net]
The Houston Association of Realtors is eliminating the phrases “master bedroom” and “master bathroom” from its real estate listings because of the slavery connotations of the word “master.” Agents are still free to use the terms in their own marketing materials and descriptions but the Multiple Listings Services (MLS) will refer to “primary bedrooms” and […]
The English language being short of words, Thomas Dimson created an AI-powered word generator. This word does not exist nephromatosis an infectious bacterial infection of the lymphatic system in primary prevention of infection in animals, caused by a nematode parasite or by an enterovirus “nephromatosis is a serious and fatal form of typhoid fever” haholus […]
The United States has never had a single “official” language. While English is broadly accepted accepted as the common tongue and typically used in schooling as well as government documents, it doesn’t necessarily have to be that way. Spanish is also used frequently across the country — but there are a lot more languages than […]
“The guitar has a kind of grit and excitement possessed by nothing else.” – Brian May If someone was assigned to turn raw sexiness into an actual, physical real-world object, it would have to be a guitar. The sound. The fit. The swagger. The allure. The longing. It’s all right there in 38 inches and […]
There was already enough concern about the healthy state of our drinking water before COVID-19. And while there’s no evidence that the coronavirus has ever been detected in the water supply, the general sense of fear surrounding any type of contamination is obviously at a fever pitch everywhere. Contaminants like lead, chromium, arsenic, copper, mercury, […]
Allergies are brutal, affecting about 30 percent of all American adults. While many only saddle sufferers with mild irritations like coughing, sneezing, a runny nose or watering eyes, some symptoms can be even more intrusive and significantly more painful. Sinus pressure is one of those unholy side effects, causing a pain that can stretch from […]