FSCrawler: you know, for files!
Laetitia Richard
David Pilato
Slide 1
Slide 2
Slide 3
Disclaimer
This project is a community project. It is not officially supported by Elastic. Support is only provided by FSCrawler community on discuss and stackoverflow.
Slide 4
FSCrawler Architecture
- Inputs:
- Local Dir
- Mount Point
- SSH / SCP
- HTTP Rest
- Filters
- JSON (noop)
- XML
- Apache Tika
- Outputs
- ES6
- ES7
Slide 5
FSCrawler Key Features
- Much more formats than ingest attachment plugin
- OCR (Tesseract)
- Much more metadata than ingest attachment plugin (See Generated Fields)
- Language detection
Slide 6
Slide 7
FSCrawler Workplace Search integration
Slide 8
FSCrawler Architecture
It now adds Workplace Search 7
Slide 9
Slide 10
Slide 11
Slide 12
Need to enrich your data?
Slide 13
Slide 14
Need to analyze your data?
Slide 15
Observe and analyze your data
Slide 16
Beware of the settings
- FSCrawler with Workplace Search output is not in watch mode (you can use systemd)
- To transform your Workplace Search index you will have to set dynamic mapping to true first (default is strict)
- If you have other standard Workplace Search connectors, you will have to transform your data in another index because the full sync refresh the content source from scratch
Slide 17
Slide 18
