Wikia Search is a new, wiki-inspired search-engine project that attempts to create a transparent set of ranking algorithms that fight spam and promote good stuff to the top. This is in contrast to Google, Yahoo, and other search engines, where the ranking algorithms are treated as trade secrets and high-risk tactics that have to be guarded from spammers.
The idea of a ranking algorithm is that it produces "good results" -- returns the best, most relevant results based on the user's search terms. We have a notion that the traditional search engine algorithm is "neutral" -- that it lacks an editorial bias and simply works to fulfill some mathematical destiny, embodying some Platonic ideal of "relevance." Compare this to an "inorganic" paid search result of the sort that Altavista used to sell.
But ranking algorithms are editorial: they embody the biases, hopes, beliefs and hypotheses of the programmers who write and design them. What's more, a tiny handful of search engines effectively control the prominence and viability of the majority of the information in the world.
And those search engines use secret ranking systems to systematically and secretly block enormous swaths of information on the grounds that it is spam, malware, or using deceptive "optimization" techniques. The list of block-ees is never published, nor are the criteria for blocking. This is done in the name of security, on the grounds that spammers and malware hackers are slowed down by the secrecy.
But "security through obscurity" is widely discredited in information security circles. Obscurity stops dumb attackers from getting through, but it lets the smart attackers clobber you because the smart defenders can't see how your system works and point out its flaws.
Seen in this light, it's positively bizarre: a few companies' secret editorial criteria are used to control what information we see, and those companies defend their secrecy in the name of security-through-obscurity? Yikes!
The Wikia Search project has assembled the basic technologies for a search engine, including a search application, search algorithm and Web crawler. The project will allow technology enthusiasts to help filter sites and rank search results, using a community model akin to that of Wikipedia.
The idea is to challenge the established players by offering a search service that is more transparent to end users, meaning they can see how search results are arrived at. Wales has described Yahoo and Google as opaque services that don't explain how results are arrived at.
(Disclosure: Jimmy Wales and I are writing a book together about a related subject)
The Empowerment Plan is a Detroit-based organization that creates manufacturing jobs making EMPWR coats that double as sleeping bags: Via designboom: the empowerment plan is a detroit-based, nonprofit organization focused on permanently elevating families from the generational cycle of homelessness. it hires single parents from local shelters and provide them with training and full-time employment […]
DJ Jesse Jarnow polled a bunch of “hardcore music nerds” to get their feature wish-list for a music-centric phone for Wired; here’s what I suggested:
The World Wide Web Consortium’s plan to standardize web-wide digital rights management is based on the idea that if an entertainment company doesn’t like a new technology, it should have the right to prevent that technology from coming into being.
Looking to upgrade your weekend? Here are three randomly awesome products on my mind this week.#3 FRESHeBUDS Pro Magnetic Bluetooth EarbudsAs more and more phones and gadgets switch to Bluetooth-only compatibility, you’ll need to get Bluetooth headphones like the rest of us. I’ve been super impressed with these affordable magnetic headphones. Pull the magnetic earbuds apart to auto-connect […]
Traditional folding wallets are designed for paper bills—but these days, carrying cash is rarely a necessity. More often than not, I don’t carry cash at all. This Bogui Clik Wallet is the best answer I’ve found for avoiding the hassle of those tight-fitting credit card pockets.This attractive, minimalist wallet features a protective lip, so my cards don’t […]
Using my iPhone while it’s charging is always a hassle. With tucked-away outlets and the meager length of included lightning cables, comfortable scrolling while plugged in is annoying. These 10-Ft MFi-Certified Lightning Cables are super convenient and probably the best iPhone accessory purchase I’ve made.At over three times the length of normal cables, these reach anywhere you […]