http://www.webascorpus.org/wacwiki/ 2012-02-05T13:16:21-07:00 http://www.webascorpus.org/wacwiki/ http://www.webascorpus.org/wacwiki/lib/images/favicon.ico text/html 2011-01-31T14:03:04-07:00 Bill Fletcher http://www.webascorpus.org/wacwiki/doku.php?id=user_posts:bill_fletcher&rev=1296507784&do=diff Bill Fletcher's Posts * Barebones PHP 5 Code to query Bing Search * Useful PHP 5 snippets for developers XMLReader; displaying objects and arrays in webpages * Notes on Sphinx Full-Text search * Setting up a Virtual Private Server (VPS) text/html 2011-01-31T14:01:12-07:00 Bill Fletcher http://www.webascorpus.org/wacwiki/doku.php?id=user_posts:bill_fletcher:phpsnippets&rev=1296507672&do=diff Useful PHP 5 snippets XMLReader Code to use XMLReader (PHP version >= 5.0) to read a modified version (English only; [download here]) of JMDict (Multilingual Japanese dictionary; see this page for further information, download and license) into a database. Unlike some other PHP XML parsers, XMLReader does not have to load the entire file into memory before parsing it, so it is much faster and has a lower memory requirements. For an introduction to XMLReader: ”Pull parsing XML in PHP”. text/html 2010-09-06T12:51:41-07:00 Bill Fletcher http://www.webascorpus.org/wacwiki/doku.php?id=user_posts:bill_fletcher:vps&rev=1283799101&do=diff An unfortunate coincidence led me to seek an alternative approach to hosting. In late July Hostmonster, my hosting provider for <http://webascorpus.org> blocked my site because certain databases were “too large” -- they exceeded an unspecified limit. I had to dump the databases and take them offline in order to reactivate my site. Then, in early August, while I was on leave in Costa Rica, USNA implemented new security measures which brought down my “Phrases in English” site at <http://pie.usna… text/html 2010-07-23T15:16:45-07:00 Bill Fletcher http://www.webascorpus.org/wacwiki/doku.php?id=wiki:wacorg&rev=1279919805&do=diff Search interface launched for new, self-expanding corpora based on English-language webpages matching user queries. Details of corpus development will appear here later. 23 July 2010: Site restored after the hosting provider summarily cut off service because certain unspecified database limits were exceeded. (Apparently unlimited doesn't actually mean 'unlimited'.) Search web corpus is temporarily disabled, but should return by the end of July. text/html 2010-07-23T15:09:52-07:00 Bill Fletcher http://www.webascorpus.org/wacwiki/doku.php?id=wiki:wacorg:searchwc&rev=1279919392&do=diff 23 July 2010 * Service taken offline while databases are restructured to meet hosting provider's limits. I hope to have the changes implemented by the end of July. 4 March 2008 * Search interface launched for new, self-expanding corpora based on English-language webpages matching user queries. Details of corpus development will appear here later. text/html 2010-06-28T16:27:07-07:00 Bill Fletcher http://www.webascorpus.org/wacwiki/doku.php?id=wiki:resources&rev=1277764027&do=diff Web as Corpus Resources APIs APIs (Application Programming Interfaces) allow developers to access online services programmatically, from applications that run on a web server or on a local machine. While they are useful, they are subject to change or elimination. This list includes notes on APIs I have come across and at least looked at. text/html 2010-06-16T10:27:03-07:00 Bill Fletcher http://www.webascorpus.org/wacwiki/doku.php?id=user_posts:bill_fletcher:sphinx&rev=1276705623&do=diff For several years I have been eying the Sphinx free open-source full-text search system, which combines flexible high-speed search with full integration with MySQL. Unlike Lucene it does not require Java, and it also appears to scale well with billions of records. In the past I was put off by the high learning threshold and the still-tentative nature of the product. By now (release 0.9.9 Dec '09) it is stable and very complete, with more to come.