TY - GEN
T1 - On updating in very short time by distributed search engines
AU - Sato, N.
AU - Uehara, M.
AU - Sakai, Y.
AU - Mori, H.
N1 - Publisher Copyright:
© 2002 IEEE.
PY - 2002
Y1 - 2002
N2 - Conventional search engines employ a centralized architecture. However, such engines are not suitable for fresh information retrieval because they take a long time to collect Web pages using a Web robot (or crawler). There are also distributed search engines such as Harvest etc., but they cannot update in a very short time, e.g. a few minutes. In this paper, we propose a distributed information retrieval system, called a cooperative search engine (CSE), in which multiple distributed local search engines communicate with each other in order to realize a whole global search engine. A local search engine has own index database and can update quickly. In addition, they cooperate with each other in order to reduce their workload. In this paper, we describe the structure and behavior of CSE, and its efficiency.
AB - Conventional search engines employ a centralized architecture. However, such engines are not suitable for fresh information retrieval because they take a long time to collect Web pages using a Web robot (or crawler). There are also distributed search engines such as Harvest etc., but they cannot update in a very short time, e.g. a few minutes. In this paper, we propose a distributed information retrieval system, called a cooperative search engine (CSE), in which multiple distributed local search engines communicate with each other in order to realize a whole global search engine. A local search engine has own index database and can update quickly. In addition, they cooperate with each other in order to reduce their workload. In this paper, we describe the structure and behavior of CSE, and its efficiency.
KW - Databases
KW - Distributed computing
KW - Information retrieval
KW - Internet
KW - Magnetooptic recording
KW - Robots
KW - Search engines
KW - Web pages
KW - Web server
KW - World Wide Web
UR - http://www.scopus.com/inward/record.url?scp=10044236876&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=10044236876&partnerID=8YFLogxK
U2 - 10.1109/SAINT.2002.994475
DO - 10.1109/SAINT.2002.994475
M3 - Conference contribution
AN - SCOPUS:10044236876
T3 - Proceedings - 2002 Symposium on Applications and the Internet, SAINT 2002
SP - 176
EP - 183
BT - Proceedings - 2002 Symposium on Applications and the Internet, SAINT 2002
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - Symposium on Applications and the Internet, SAINT 2002
Y2 - 28 January 2002 through 1 February 2002
ER -