studioespresso / craft-scout
Craft Scout provides a simple solution for adding full-text search to your entries. Scout will automatically keep your search indexes in sync with your entries.
Fund package maintenance!
janhenckens
Installs: 109 830
Dependents: 0
Suggesters: 0
Security: 0
Stars: 81
Watchers: 6
Forks: 54
Open Issues: 13
Type:craft-plugin
Requires
- php: ^8.2.0
- algolia/algoliasearch-client-php: ^2.3|^3.0
- craftcms/cms: ^5.0.0-beta.1
- league/fractal: ^0.20
Requires (Dev)
- codeception/codeception: ^5.0.0
- codeception/lib-asserts: ^2.1.0
- codeception/module-asserts: ^3.0
- codeception/module-yii2: ^1.1.10
- craftcms/ecs: dev-main
- craftcms/phpstan: dev-main
- phpunit/phpunit: ^11.2.7
- vlucas/phpdotenv: ^5.3.0
Conflicts
- craftcms/element-api: <4.0.0
- v5.x-dev
- 5.0.3
- 5.0.2
- 5.0.1
- 5.0.0
- 5.0.0-beta.1
- 5.0.0-alpha.1
- 4.1.2
- 4.1.1
- 4.1.0
- 4.1.0-beta.2
- 4.1.0-beta.1
- 4.0.0
- 3.4.1
- 3.4.0
- 3.3.3
- 3.3.3-beta.2
- 3.3.3-beta.1
- 3.3.2
- 3.3.1
- 3.3.0
- 3.2.1
- 3.2.0
- 3.1.3
- 3.1.2.x-dev
- 3.1.2
- 3.1.1
- 3.1.0
- 3.0.0
- 3.0.0-beta.1
- 2.8.1
- 2.8.0
- 2.8.0-beta.3
- 2.8.0-beta.2
- 2.8.0-beta.1
- 2.7.2
- 2.7.1
- 2.7.0
- 2.6.1
- 2.6.0
- 2.5.0
- 2.4.2
- 2.4.1
- 2.4.0
- 2.3.1
- 2.3.0
- 2.2.2
- 2.2.1
- 2.2.0
- 2.1.4
- 2.1.3
- 2.1.2
- 2.1.1
- 2.1.0
- 2.0.2
- 2.0.1
- 2.0.0
- 1.3.2
- 1.3.1
- 1.3.0
- 1.2.3
- 1.2.2
- 1.2.1
- 1.2.0
- 1.1.4
- 1.1.3
- 1.1.2
- 1.1.1
- 1.1.0
- 1.0.2
- 1.0.1
- 1.0.0
- 0.4.2
- 0.4.1
- 0.4.0
- 0.3.0
- 0.2.8
- 0.2.7
- 0.2.6
- 0.2.5
- 0.2.4
- 0.2.3
- 0.2.2
- 0.2.1
- 0.2.0
- 0.1.1
- dev-dependabot/composer/algolia/algoliasearch-client-php-tw-4.11.2
- dev-dependabot/composer/algolia/algoliasearch-client-php-tw-4.11.1
- dev-develop-v5
- dev-develop
- dev-master
- dev-feature/debug-mode
- dev-260-native-search-index-to-algolia
- dev-craft3
- dev-override-batch-size
This package is auto-updated.
Last update: 2024-12-19 04:45:12 UTC
README
Craft Scout provides a simple solution for adding full-text search to your entries. Scout will automatically keep your search indices in sync with your entries.
Requirements
This plugin requires Craft CMS 4.x or later and PHP 8.0.2 or later.
Installation
Open your terminal and go to your Craft project:
# go to the project directory cd /path/to/my-craft-project.dev # tell Composer to install the plugin composer require studioespresso/craft-scout # tell Craft to install the plugin php craft plugin/install scout
Setup
To define your indices, copy the scout.php file to your config
folder.
<?php return [ /* * Scout listens to numerous Element events to keep them updated in * their respective indices. You can disable these and update * your indices manually using the commands. */ 'sync' => true, /* * * @depcretio * By default Scout handles all indexing in a queued job, you can disable * this so the indices are updated as soon as the elements are updated * * Disabling the `queue` option will no longer be supported in the next version of Scout * */ 'queue' => true, /* * The connection timeout (in seconds), increase this only if necessary */ 'connect_timeout' => 1, /* * The batch size Scout uses when importing a large amount of elements */ 'batch_size' => 1000, /* * By default Scout will index elements related to the element being save (that are in the same index). * Disabling this can improve performance on larger sites that have lots of relations. */ 'indexRelations' => true, /** * The element types to look for when indexRelations is enabled. * By default, all Craft elements are checked for relations. * Use this to avoid unnecessary queries to Elements that aren't * used by your indices or to check custom Elements that may be * related to your indices */ 'relatedElementTypes' => [], /* * The Algolia Application ID, this id can be found in your Algolia Account * https://www.algolia.com/api-keys. This id is used to update records. */ 'application_id' => '$ALGOLIA_APPLICATION_ID', /* * The Algolia Admin API key, this key can be found in your Algolia Account * https://www.algolia.com/api-keys. This key is used to update records. */ 'admin_api_key' => '$ALGOLIA_ADMIN_API_KEY', /* * The Algolia search API key, this key can be found in your Algolia Account * https://www.algolia.com/api-keys. This search key is not used in Scout * but can be used through the Scout variable in your template files. */ 'search_api_key' => '$ALGOLIA_SEARCH_API_KEY', //optional /* * A collection of indices that Scout should sync to, these can be configured * by using the \rias\scout\ScoutIndex::create('IndexName') command. Each * index should define an ElementType, criteria and a transformer. */ 'indices' => [], ];
Example Index Configuration
<?php return [ 'indices' => [ \rias\scout\ScoutIndex::create('Blog') // Scout uses this by default, so this is optional ->elementType(\craft\elements\Entry::class) // If you don't define a siteId, the primary site is used ->criteria(function (\craft\elements\db\EntryQuery $query) { return $query->section('blog'); }) /* * The element gets passed into the transform function, you can omit this * and Scout will use the \rias\scout\ElementTransformer class instead */ ->transformer(function (\craft\elements\Entry $entry) { return [ 'title' => $entry->title, 'body' => $entry->body, ]; }) /* * You can use this to define index settings that get synced when you call * the ./craft scout/settings/update console command. This way you can * keep your index settings in source control. The IndexSettings * object provides autocompletion for all Algolia's settings */ ->indexSettings( \rias\scout\IndexSettings::create() ->minWordSizefor1Typo(4) ) ], ];
->elementType(string $class)
The element type that this index contains, by default Scout uses craft\elements\Entry::class
Craft's default element type classes are:
craft\elements\Asset
craft\elements\Entry
craft\elements\User
->criteria(callable $query)
This function accepts an ElementQuery
and should also return an ElementQuery
->criteria(function (ElementQuery $query) { return $query->section('blog'); });
->transformer(callable|string|array|TransformerAbstract $transformer)
The transformer that should be used to define the data that should be sent to Algolia for each element. If you don’t set this, the default transformer will be used, which includes all of the element’s direct attribute values, but no custom field values.
// Can be set to a function ->transformer(function(craft\elements\Entry $entry) { return [ 'title' => $entry->title, 'id' => $entry->id, 'url' => $entry->url, ]; }), // Or a string/array that defines a Transformer class configuration ->transformer('MyTransformerClassName'), // Or a Transformer class instance ->transformer(new MyTransformerClassName()),
Your custom transformer class would look something like this:
<?php use craft\elements\Entry; use League\Fractal\TransformerAbstract; class MyTransformerClassName extends TransformerAbstract { public function transform(Entry $entry) { return [ // ... ]; } }
->splitElementsOn(array $keys)
For long documents it is advised to divide the element into multiple rows to keep each row within row data size. This can be done using splitElementsOn()
.
Make sure to return an array in your transformer for these keys.
->splitElementsOn([ 'summary', 'matrixFieldHandle' ])
Important -
distinctID
(available after indexing) must be set up as an attribute for faceting for deletion of objects to work when using splitElementsOn.
->indexSettings(IndexSettings $settings)
You can use this to define index settings that get synced when you call the ./craft scout/settings/update
console command.
This way you can keep your index settings in source control.
The IndexSettings object provides autocompletion for all Algolia's settings
Note
Note that settings are not synced automatically, but only when the ./craft scout/settings/update
console command is run.
->indexSettings( \rias\scout\IndexSettings::create() ->minWordSizefor1Typo(4) )
Replicas
Replicas can be created with the replicas
function on IndexSettings
. To configure replicas, include them in the indices
array and set their replicaIndex
to true
so that they are not included in any syncing operations.
Replica indices can have their configuration updated using the ./craft scout/settings/update
console command.
<?php return [ 'indices' => [ \rias\scout\ScoutIndex::create('Products') // ... ->indexSettings( \rias\scout\IndexSettings::create() ->minWordSizefor1Typo(4) ->replicas(['virtual(Products_desc)']) ) ], [ \rias\scout\ScoutIndex::create('Products_desc') ->replicaIndex(true) ->indexSettings(IndexSettings::create()->customRanking(['desc(price)'])), ], ];
Twig variables
You can access the Algolia settings set in your config file through the following Twig variables.
{{ craft.scout.pluginName }} {{ craft.scout.algoliaApplicationId }} {{ craft.scout.algoliaAdminApiKey }} {{ craft.scout.algoliaSearchApiKey }}
Console commands
Scout provides two easy console commands for managing your indices.
Importing
To import one or all indices you can run the following console command
./craft scout/index/import <indexName?>
The indexName
argument is not required, all your mappings will be imported when you omit it.
Flushing/Clearing
Clearing an index is as easy as running a command in your console.
./craft scout/index/flush <indexName?>
As with the import command, indexName
is not required.
When flushing, Scout will ask you to confirm that you really want to clear all the data in your index. You can bypass the confirmation by appending a --force
flag.
Refreshing
Does a flush/clear first and then imports the index again.
./craft scout/index/refresh <indexName?>
Skipping an Element
You can omit an element from being indexed by returning an empty array from the transform
method:
ScoutIndex::create() ->transform(function (Entry $entry) { // Check if entry is valid for indexing $isValid = yourCustomValidation($entry); // If entry fails validation, return empty array if (! $isValid) { return []; } // Return normal data attributes return [ 'name' => $entry->title, ... 'lorem' => $entry->lorem, 'ipsum' => $entry->ipsum, ]; });
Events
ShouldBeSearchableEvent
This event allows you to customize which elements or element types get checked on save (or more specifically, every time the SearchableBehaviour
is triggered).
use rias\scout\behaviors\SearchableBehavior; use rias\scout\events\ShouldBeSearchableEvent; Event::on( SearchableBehavior::class, SearchableBehavior::EVENT_SHOULD_BE_SEARCHABLE, function (ShouldBeSearchableEvent $event) { $event->shouldBeSearchable = false; });
The event has a properties:
- $element (the element being saved)
- $shouldBeSearchable (wether or not the element should be searchable, defaults to
true
)
An example use-case for this would be to check the type of the element that's being saved and settings shouldBeSearchable
to false
when it's a Matrix block.
AfterIndexImport
This event runs at the end of the ImportIndex
job, when every item has been processed.
use rias\scout\events\AfterIndexImport; use rias\scout\jobs\ImportIndex; Event::on( ImportIndex::class, ImportIndex::EVENT_AFTER_INDEX_IMPORT, function (AfterIndexImport $event) { // Your code here });
The event has one property:
- $indexName (the name of the index that just finished importing
An example use-case for this would be to keep a log or dateLastImported if you're running imports on a schedule.
Upgrading from 1.x
The configuration has changed from how Scout v1 did its configuration. Please see the setup section below on how to configure Scout.
The following changes are the most notable:
- The
mappings
configuration key has been changed toindices
and there is a new way to configure the indices - The
criteria
is now a callable that returns anElementQuery
. Every Index should define asiteId
in the criteria, otherwise the primary site is chosen. - New
queue
andbatch
options added to the settings - Old confuguration keys on the mappings have been replaced by functions on the
rias\scout\ScoutIndex
object.
Brought to you by Studio Espresso and Rias