afs_japanese_preprocess - AFS - Reference Guides

AFS Filters Description

Product
AFS
Platform
7.11
Category
Reference Guides
Language
English

The Japanese preprocessing filter is used, in association with the indexing filter, when the documents content is in Japanese and contains japanese halfwidth characters and/or latin fullwidth characters.

The filter is declared with the afs_japanese_preprocess type. It is in the antidot-paf-misc package. It is a processor filter.

This filter can be instantiated only once at any given moment. It will not read the "instances" parameter in the configuration.

The Japanese preprocessing filter specifications are described in the following table:

Parameter name

Mandatory

Type

Default

Description

input_layer

No

layer

CONTENTS

Layer read by the filter.

output_layer

No

string

CONTENTS

Output layer of the filter

This filter must be used when Japanese documents contain katakana halfwidth characters in order to avoid bad tokenization in the indexer.