Сообщений в теме: 6

[SmetDenis]

Хак, представленный ниже, появился после обсуждения следующего топика.
Он позволяет отсекать окончания слов и удалять стоп-слова перед запросом в базу данных.
 
В качестве старта использовал задумку http://ruseller.com/...?rub=37&id=1264
Как и в большинстве уроков на ruseller - там туча мелких ошибок. Что нашел - исправил.


Важно!

• Список возможных окончаний перечислен в _dropBackWords()
• Стоп-слова - это список "бессмысленных" частиц, который не нужно учитывать во время поиска. Примеры перечислены в _stopWords()
• Слова короче 3-х символов будут исключены

 


Таким образом, если искать фразу

все красные шторы

то по факту в запросе будут участвовать слова

красн штор

Внимание! Работает только в полнотекстовом режиме поиска.
Я проверял на JBZoo 2.1.5 После установки, внимательно проверяйте фильтры, связанные элементы и модуль материалов.

Установка
Заменить этот файл
media\zoo\applications\jbuniversal\framework\models\jbmodel.php

Прикрепленные файлы

•  jbmodel.php   13.19К   147 Количество загрузок:

Сообщение отредактировал SmetDenis: 17 September 2014 - 06:42
Перезалил файл с фиксом для коротких слов

[black_paw]

что-то у меня, если слово менее 3 символов задано в поиске выдает вот такое

1064 You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ') )' at line 3 SQL=SELECT item_id FROM 43hg85_zoo_jbzoo_index_1job AS tIndex WHERE ((tIndex.e_cb01156f4cc3471bb3ea3e7892d6b861_s LIKE ) )

и в не все, но многие материалы материалы отдают такое же, только по богаче

Spoiler

1064 You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN al' at line 84 SQL=SELECT tAll.id , COUNT(tAll.id) AS count FROM (( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_category_item AS tCategoryItem ON tCategoryItem.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tCategoryItem.category_id LIKE '%636%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tItem.name LIKE '%продавец,%' AND tItem.name LIKE '%бухгалтер,кассир%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_475de663f0c14581acfd63c260a853b1_s LIKE '%Златоуст\\nЧелябинск%' AND tIndex.e_475de663f0c14581acfd63c260a853b1_s LIKE '%област%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_3deb6123a1c042c19e7cd308e9423d9e_s LIKE '%8000%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_d584d1ea061d48228870a165a09b7de9_s LIKE '%Резюм%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_cb01156f4cc3471bb3ea3e7892d6b861_s LIKE '%продавец,%' AND tIndex.e_cb01156f4cc3471bb3ea3e7892d6b861_s LIKE '%бухгалтер,кассир%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_87680e2bdc2247ad96f9c6fc33af20aa_s LIKE )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_fecdb53b999a4e91a69585113b500583_s LIKE '%полн%' AND tIndex.e_fecdb53b999a4e91a69585113b500583_s LIKE '%рабоч%' AND tIndex.e_fecdb53b999a4e91a69585113b500583_s LIKE '%ден%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_336f243b011b444fa506359ac8565b8d_s LIKE '%Постоянн%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_dd310393978a48b0b5d3976004ee46a3_s LIKE '%год%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_5a7253bb5ae34756a15e9b928f64e294_s LIKE '%ОО%' AND tIndex.e_5a7253bb5ae34756a15e9b928f64e294_s LIKE '%«Златмясокомбинат»%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_b19bf8f632234bcfa711011c457fad61_s LIKE '%высше%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_8483aaad20da4fa488ed6c53a03f8ce3_s LIKE '%ест%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_4d5094f852344b7390db4f2d5cbeabb1_s LIKE )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_8d3983cc8d6445d594f3c6138bfb6a61_s LIKE '%Анн%' AND tIndex.e_8d3983cc8d6445d594f3c6138bfb6a61_s LIKE '%Александровн%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_382a1b50d818400891de7252f8d39bfb_s LIKE '%+79194035133%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_1fe6498e81af4375acdfb4a9ceb3b99c_s LIKE '%недел%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_34ec13e82fc74ff2a550558dcaef0b25_s LIKE '%Бухгалтерск%' AND tIndex.e_34ec13e82fc74ff2a550558dcaef0b25_s LIKE '%учет%' )) ) UNION ALL ( SELECT tItem.id AS id FROM 43hg85_zoo_item AS tItem LEFT JOIN 43hg85_zoo_jbzoo_index_1job AS tIndex ON tIndex.item_id = tItem.id WHERE tItem.access IN (1,2,3) AND tItem.state = '1' AND (tItem.publish_up = '0000-00-00 00:00:00' OR tItem.publish_up <= '2014-09-15 08:45:57') AND (tItem.publish_down = '0000-00-00 00:00:00' OR tItem.publish_down >= '2014-09-15 08:45:57') AND tItem.id <> '21521' AND tItem.application_id = '6' AND ((tIndex.e_8af8e8a3e7654e9b879cb16cbf606fdb_s LIKE '%Персонал%' )) )) AS tAll GROUP BY tAll.id HAVING count >= '4' ORDER BY count DESC LIMIT 5

[SmetDenis]

хм, у меня такие слова просто не учитывались.
А какой тип элемента и какая фраза была?

[black_paw]

элемент textarea, шаблон в фильтре: текстовое поле, в модуле: полнотекстовый поиск

фраза любая короче 3-х символов, напр. 'Бу' ))

А в full похоже вылетает из-за релевантных

[SmetDenis]

Спасибо, понял. Сегодня посмотрю.

[SmetDenis]

Перезалил файл.

[SmetDenis]

Для тех, кому не нужно учитывать длину слов замените этот код в файле

 

на

            if (JString::strlen($word) < 3) {
                $keywords[] = $word;
            } else {
                $keywords[] = $this->_dropBackWords($word);
            }