您的位置主页 > PHP

Shpinx在win上的安装调试笔记

转载:
SphinxSE方式,一般数据库管理员使用
此篇文章作者深入浅出的说明了sphinx的安装调试过程.

转了一篇Sphinx 全文搜索引擎速成指南,今天在本机(WinXp)尝试安装Sphinx,成功。记录一下,有些步骤和原文中略有不同。


MYSQL原来就已安装好,什么版本倒是不记得了,文中说要装ySQL5.0.45版,去其官网都找不到这个版本的下载。
从Sphinx官网上http://www.sphinxsearch.com/downloads.html下载mysql-5.0.45-sphinxse-r871-win32.zip和sphinx-0.9.8-svn-r985-win32.zip 。停掉MySQL服务,解压mysql-5.0.45-sphinxse-r871-win32.zip,将里面bin与share目录覆盖掉你的mysql安装目录下的相应目录,启动MySQL。
hx注:此步骤的目的是为mySQL安装sphinxSE Engine驱动,这样mysql才能直接连Sphinx的索引文件来输出查询结果。
解压sphinx-0.9.8-svn-r985-win32.zip ,将里面的文件解压到C:\www\sphinx 。我的mysql,apache都是安装在c:\www目录的。
至此安装完毕,MS好简单,呵呵:)相比Linux下的安装,实在是太简单了!

sphinx的配置文件是其目录下的sphinx.conf,默认不存在,只需将sphinx-old.conf复制一份为sphinx.conf即可。看其默认配置,需要data和logs目录,就创建了这两个目录。把@CONFDIR@批量改为C:\www\。
其目录下带了一个example.sql,就用它创建了test数据库,

假定我的数据库名是hxtest,我需要对SELECT id,title,tags,hits,addtime FROM hx_content的title和tags两个文本字段进行索引,则以下是整理过的Sphinx的配置参数,可以加在头部

source hxtest
{
type = mysql
sql_host = localhost
sql_user = root
sql_pass = 123456
sql_db = hxtest
sql_port= 3306 # optional, default is 3306
sql_query_pre=   SET NAMES utf8

sql_query = SELECT id,title,tags,hits,addtime\
FROM hx_content
sql_attr_uint= hits
sql_attr_timestamp = addtime

sql_query_post   =
sql_ranged_throttle= 0

}
index hxtest
{
source   = hxtest
path   = c:/www/sphinx/data/hxtest
docinfo   = extern
mlock   = 0
morphology   = none
stopwords   =
min_word_len   = 1
charset_type   = utf-8
charset_table = U+FF10..U+FF19->0..9, 0..9, U+FF41..U+FF5A->a..z, U+FF21..U+FF3A->a..z,\
A..Z->a..z, a..z, U+0149, U+017F, U+0138, U+00DF, U+00FF, U+00C0..U+00D6->U+00E0..U+00F6,\
U+00E0..U+00F6, U+00D8..U+00DE->U+00F8..U+00FE, U+00F8..U+00FE, U+0100->U+0101, U+0101,\
U+0102->U+0103, U+0103, U+0104->U+0105, U+0105, U+0106->U+0107, U+0107, U+0108->U+0109,\
U+0109, U+010A->U+010B, U+010B, U+010C->U+010D, U+010D, U+010E->U+010F, U+010F,\
U+0110->U+0111, U+0111, U+0112->U+0113, U+0113, U+0114->U+0115, U+0115, \
U+0116->U+0117,U+0117, U+0118->U+0119, U+0119, U+011A->U+011B, U+011B, U+011C->U+011D,\
U+011D,U+011E->U+011F, U+011F, U+0130->U+0131, U+0131, U+0132->U+0133, U+0133, \
U+0134->U+0135,U+0135, U+0136->U+0137, U+0137, U+0139->U+013A, U+013A, U+013B->U+013C, \
U+013C,U+013D->U+013E, U+013E, U+013F->U+0140, U+0140, U+0141->U+0142, U+0142, \
U+0143->U+0144,U+0144, U+0145->U+0146, U+0146, U+0147->U+0148, U+0148, U+014A->U+014B, \
U+014B,U+014C->U+014D, U+014D, U+014E->U+014F, U+014F, U+0150->U+0151, U+0151, \
U+0152->U+0153,U+0153, U+0154->U+0155, U+0155, U+0156->U+0157, U+0157, U+0158->U+0159,\
U+0159,U+015A->U+015B, U+015B, U+015C->U+015D, U+015D, U+015E->U+015F, U+015F, \
U+0160->U+0161,U+0161, U+0162->U+0163, U+0163, U+0164->U+0165, U+0165, U+0166->U+0167, \
U+0167,U+0168->U+0169, U+0169, U+016A->U+016B, U+016B, U+016C->U+016D, U+016D, \
U+016E->U+016F,U+016F, U+0170->U+0171, U+0171, U+0172->U+0173, U+0173, U+0174->U+0175,\
U+0175,U+0176->U+0177, U+0177, U+0178->U+00FF, U+00FF, U+0179->U+017A, U+017A, \
U+017B->U+017C,U+017C, U+017D->U+017E, U+017E, U+0410..U+042F->U+0430..U+044F, \
U+0430..U+044F,U+05D0..U+05EA, U+0531..U+0556->U+0561..U+0586, U+0561..U+0587, \
U+0621..U+063A, U+01B9,U+01BF, U+0640..U+064A, U+0660..U+0669, U+066E, U+066F, \
U+0671..U+06D3, U+06F0..U+06FF,U+0904..U+0939, U+0958..U+095F, U+0960..U+0963, \
U+0966..U+096F, U+097B..U+097F,U+0985..U+09B9, U+09CE, U+09DC..U+09E3, U+09E6..U+09EF, \
U+0A05..U+0A39, U+0A59..U+0A5E,U+0A66..U+0A6F, U+0A85..U+0AB9, U+0AE0..U+0AE3, \
U+0AE6..U+0AEF, U+0B05..U+0B39,U+0B5C..U+0B61, U+0B66..U+0B6F, U+0B71, U+0B85..U+0BB9, \
U+0BE6..U+0BF2, U+0C05..U+0C39,U+0C66..U+0C6F, U+0C85..U+0CB9, U+0CDE..U+0CE3, \
U+0CE6..U+0CEF, U+0D05..U+0D39, U+0D60,U+0D61, U+0D66..U+0D6F, U+0D85..U+0DC6, \
U+1900..U+1938, U+1946..U+194F, U+A800..U+A805,U+A807..U+A822, U+0386->U+03B1, \
U+03AC->U+03B1, U+0388->U+03B5, U+03AD->U+03B5,U+0389->U+03B7, U+03AE->U+03B7, \
U+038A->U+03B9, U+0390->U+03B9, U+03AA->U+03B9,U+03AF->U+03B9, U+03CA->U+03B9, \
U+038C->U+03BF, U+03CC->U+03BF, U+038E->U+03C5,U+03AB->U+03C5, U+03B0->U+03C5, \
U+03CB->U+03C5, U+03CD->U+03C5, U+038F->U+03C9,U+03CE->U+03C9, U+03C2->U+03C3, \
U+0391..U+03A1->U+03B1..U+03C1,U+03A3..U+03A9->U+03C3..U+03C9, U+03B1..U+03C1, \
U+03C3..U+03C9, U+0E01..U+0E2E,U+0E30..U+0E3A, U+0E40..U+0E45, U+0E47, U+0E50..U+0E59, \
U+A000..U+A48F, U+4E00..U+9FBF,U+3400..U+4DBF, U+20000..U+2A6DF, U+F900..U+FAFF, \
U+2F800..U+2FA1F, U+2E80..U+2EFF,U+2F00..U+2FDF, U+3100..U+312F, U+31A0..U+31BF, \
U+3040..U+309F, U+30A0..U+30FF,U+31F0..U+31FF, U+AC00..U+D7AF, U+1100..U+11FF, \
U+3130..U+318F, U+A000..U+A48F,U+A490..U+A4CF
min_prefix_len   = 0
min_infix_len   = 1
ngram_len = 1

}

原文中有一些这个版本不支持了,已经去掉。其中charset_table这块是支持中文用的,啥原理暂不明白。

CMD切换到安装目录
cd c:\www\sphinx
对表进行索引:
C:\www\sphinx>bin\indexer --config sphinx.conf hxtest
Sphinx 0.9.8-release (r1533)
Copyright (c) 2001-2008, Andrew Aksyonoff

using config file 'sphinx.conf'...
indexing index 'hxtest'...
collected 153168 docs, 10.1 MB
sorted 19.8 Mhits, 99.5% done
total 153168 docs, 10124106 bytes
total 17.164 sec, 589840.47 bytes/sec, 8923.72 docs/sec

开启searchd,系统会在3312端口侦听mysql的全文检索请求
C:\www\sphinx>bin\searchd --config sphinx.conf
Sphinx 0.9.8-release (r1533)
Copyright (c) 2001-2008, Andrew Aksyonoff

WARNING: forcing --console mode on Windows
using config file 'sphinx.conf'...
creating server socket on 0.0.0.0:3312
WARNING: index 'test1stemmed': preload: failed to open c:/www/sphinx/data/test1s
temmed.sph: No such file or directory; NOT SERVING
WARNING: index 'dist1': no such local index 'test1stemmed' - SKIPPING LOCAL INDE
X
accepting connections

提示了警告,不过不影响使用。
此DOS窗口就不能关闭了,关了就停了。



为了使在sphinx索引到的数据在mysql中可以直接读取,需要在此数据库中创建一个ENGINE=SPHINX 的sphinx表。

CREATE TABLE IF NOT EXISTS `sphinx` (
   `id` int(11) NOT NULL,
   `weight` int(11) NOT NULL,
   `query` varchar(255) NOT NULL
   KEY `Query` (`query`)
) ENGINE=SPHINX DEFAULT CHARSET=utf8;

好了,配置也完成了!

在PHPMYADMIN中查询:
引用
SELECT *
FROM hx_content AS c, sphinx AS t
WHERE c.id = t.id
AND query = '影视'
ORDER BY c.id DESC

显示行 0 - 19 (20 总计, 查询花费 0.0044 秒)

测试成功!

而如果使用传统的like查询
引用
SELECT *
FROM hx_content
WHERE title LIKE '%影视%'
OR tags LIKE '%影视%'
ORDER BY id DESC
LIMIT 20

显示行 0 - 19 (20 总计, 查询花费 0.0132 秒)

不过,发现了个问题,总是只显示20条,查了下文档,原来其限制为20条。如果需要更多数据的话,可以加个limit参数,如下限制最多1000条:
SELECT * FROM hx_content AS c, sphinx AS t
WHERE c.id = t.id
AND query = '影视;limit=1000'
没有order by 的话,sphinx会按照它认为的匹配的权重来排序。

又测试了下:
引用
SELECT *
FROM hx_content
WHERE title LIKE '%影视%'
OR tags LIKE '%影视%'
ORDER BY id DESC
LIMIT 100

显示行 0 - 29 (100 总计, 查询花费 0.0751 秒)
引用
SELECT *
FROM hx_content AS c, sphinx AS t
WHERE c.id = t.id
AND query = '影视;limit=100'
ORDER BY c.id DESC

显示行 0 - 29 (100 总计, 查询花费 0.0059 秒)


至此一个简单又高效的全文检索系统就安装完成了,虽然没有中文分词功能,但对于某些环境下来说已经够用了。