Elasticsearch

A presentation at BBL Crédit Agricole Technologies et Services (Private Event) in March 2020 in Montpellier, France by David Pilato

Slide 1

Slide 1

Elastic Stack Overview Search. Observe. Protect.

Slide 2

Slide 2

Who? $ curl http://localhost:9200/speaker/_doc/dpilato { “nom” : “David Pilato”, “jobs” : [ { “boite” : “SRA Europe (SSII)”, “mission” : “bon à tout faire”, “date” : “1995” }, { “boite” : “SFR”, “mission” : “touche à tout”, “date” : “1997” }, { “boite” : “e-Brands / Vivendi”, “mission” : “chef de projets”, “date”: “2000” }, { “boite” : “DGDDI (douane)”, “mission” : “mouton à 5 pattes”, “date” : “2005” }, { “boite” : “IDEO Technologies”, “mission” : “CTO”, “date” : “2012” }, { “boite” : “elastic”, “mission” : “développeur”, “date” : “2013” } ], “passions” : [ “famille”, “job”, “deejay” ], “blog” : “http://david.pilato.fr/”, “twitter” : [ “@dadoonet”, “@elasticfr” ], “email” : “david@pilato.fr” } 2

Slide 3

Slide 3

The Elastic Stack Reliably and securely take data from any source, in any format, then search, analyze, and visualize it in real time.

Slide 4

Slide 4

FILEBEAT MASTER (3) METRICBEA T PACKETBEAT WINGLOBEAT AUDITBEAT HEARTBEAT CUSTOM UI INGEST (X) Coordinating (X) DATA - HOT (X) FUNCTION BEAT KAFKA ELASTICSEARCH CLIENTS DATA - WARM (X) REDIS DATA STORE SOCIAL 4 WEB APIS SENSORS MESSAGING QUEUE WORKERS (2+) ALERTING (X) MACHINE LEARNING (2+) INSTANCES (X)

Slide 5

Slide 5

Deploy anywhere. Elastic Cloud SaaS Elastic Cloud Enterprise Elastic Cloud on Kubernetes Orchestration

Slide 6

Slide 6

https://www.elastic.co/fr/subscriptions

Slide 7

Slide 7

Services at a Glance Elastic Training Certification • Immersive learning experience • Performance-based exam • Solution-based curriculum • Solve real-world tasks, in realtime • Flexible ways-to-train • Remote, secure testing People Strategy 7 Elastic Consulting • Expert services focused on your business goals • Phased-based packages • Product expertise Project Strategy

Slide 8

Slide 8

En Elastic Training Paris / France fra nç ais Course offerings Elasticsearch Engineer I: Apr 20-21 IMMERSIVE LEARNING SOLUTION-BASED Elasticsearch Engineer II: Apr 22-23 ENVIRONMENT CURRICULUM Lab-based exercises to help master Real-world examples and common new skills use cases EXPERIENCED PERFORMANCE-BASED INSTRUCTORS CERTIFICATION Expertly trained and deeply rooted in Apply skills to real-world use cases, in everything Elastic real-time Who should attend? Software Developers, Engineers, Data Architects, System Administrators, DevOps What will I learn? ● How to manage deployments and develop solutions. ● Advanced cluster management techniques, best practices for capacity planning and scaling, and more. 50% discount on the 2nd seat - discount until Feb 24th

Slide 9

Slide 9

A typical search implementation… CREATE TABLE user ( name VARCHAR(100), comments VARCHAR(1000) ); INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INSERT INTO user VALUES (‘Malloum Laya’, ‘Worked with David at french customs service’); INSERT INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INSERT INTO user VALUES (‘David David’, ‘Who is that guy?’); David 9

Slide 10

Slide 10

Search on term INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name=”David”; Empty set (0,00 sec) David 10

Slide 11

Slide 11

Search like INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%David%”; +———————+———————————+ | name | comments | +———————+———————————+ | David Pilato | Developer at elastic | | David Gageot | Engineer at Google | | David David | Who is that guy? | +———————+———————————+ David 11

Slide 12

Slide 12

Search for terms INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%David Pilato%”; +———————+———————————+ | name | comments | +———————+———————————+ | David Pilato | Developer at elastic | +———————+———————————+ David Pilato 12

Slide 13

Slide 13

Search with inverted terms INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%Pilato David%”; Empty set (0,00 sec) SELECT * FROM user WHERE name LIKE “%Pilato%David%”; Empty set (0,00 sec) Pilato David 13

Slide 14

Slide 14

Search for terms INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%David%” AND name LIKE “%Pilato%”; +———————+———————————+ | name | comments | +———————+———————————+ | David Pilato | Developer at elastic | +———————+———————————+ Pilato David 14

Slide 15

Slide 15

Search in two fields INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%David%” OR comments LIKE “%David%”; +———————+——————————————————————-+ | name | comments | +———————+——————————————————————-+ | David Pilato | Developer at elastic | | Malloum Laya | Worked with David at french customs service | | David Gageot | Engineer at Google | | David David | Who is that guy? | +———————+——————————————————————-+ David 15

Slide 16

Slide 16

Slide 17

Slide 17

Search with typos INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%Dadid%”; Empty set (0,00 sec) Dadid 17

Slide 18

Slide 18

Search with typos INSERT INSERT french INSERT INSERT INTO user VALUES (‘David Pilato’, ‘Developer at elastic’); INTO user VALUES (‘Malloum Laya’, ‘Worked with David at customs service’); INTO user VALUES (‘David Gageot’, ‘Engineer at Google’); INTO user VALUES (‘David David’, ‘Who is that guy?’); SELECT * FROM user WHERE name LIKE “%adid%” OR name LIKE “%D_did%” OR name LIKE “%Da_id%” OR name LIKE “%Dad_d%” OR name LIKE “%Dadi%”; +———————+———————————+ | name | comments | +———————+———————————+ | David Pilato | Developer at elastic | | David Gageot | Engineer at Google | | David David | Who is that guy? | +———————+———————————+ 18

Slide 19

Slide 19

Slide 20

Slide 20

User Interface 20

Slide 21

Slide 21

Search engine? Moteur d’indexation de documents Moteur de recherche dans les index 21

Slide 22

Slide 22

Demo time!

Slide 23

Slide 23

3 solutions powered by 1 stack Elastic Enterprise Search Elastic Observability Elastic Security Kibana Elasticsearch Beats Logstash Elastic Stack

Slide 24

Slide 24

Elastic Enterprise Search Workplace Search App Search Site Search

Slide 25

Slide 25

ELASTIC ENTERPRISE SEARCH Search everything, anywhere Easily implement powerful, modern search experiences across your website, app, or digital workplace. Search it all, simply.

Slide 26

Slide 26

Elastic Observability Logs Metrics APM Uptime

Slide 27

Slide 27

ELASTIC OBSERVABILITY Unified visibility across your entire ecosystem Bring your logs, metrics, and traces together into a single stack so you can monitor, detect, and react to events with speed.

Slide 28

Slide 28

Elastic Security Endpoint SIEM

Slide 29

Slide 29

ELASTIC SECURITY Security how it should be: open Elastic Security integrates endpoint security and SIEM to give you prevention, collection, detection, and response capabilities for unified protection across your infrastructure.

Slide 30

Slide 30

Deploy anywhere. Elastic Cloud SaaS Elastic Cloud Enterprise Elastic Cloud on Kubernetes Orchestration

Slide 31

Slide 31

ELASTIC CLOUD Family of SaaS Offerings Easily launch, operate, and scale deployments on AWS, GCP, or Azure with a SaaS experience tailor-made for Elastic products and solutions.

Slide 32

Slide 32

ELASTIC CLOUD ENTERPRISE Centrally manage your Elastic deployments Provision, manage, and monitor Elastic products and solutions, at any scale, on any infrastructure, while managing everything from a single console.

Slide 33

Slide 33

ELASTIC CLOUD ON KUBERNETES Official Operator, and much more Simplify setup, upgrades, snapshots, scaling, high availability, security, and more when running Elastic products and solutions on Kubernetes.

Slide 34

Slide 34

Slide 35

Slide 35

Searching for Rides

Slide 36

Slide 36

Searching for Restaurants

Slide 37

Slide 37

Searching for Love

Slide 38

Slide 38

Slide 39

Slide 39

#ElasticStories

Slide 40

Slide 40

En Elastic Training Paris / France fra nç ais Course offerings Elasticsearch Engineer I: Apr 20-21 IMMERSIVE LEARNING SOLUTION-BASED Elasticsearch Engineer II: Apr 22-23 ENVIRONMENT CURRICULUM Lab-based exercises to help master Real-world examples and common new skills use cases EXPERIENCED PERFORMANCE-BASED INSTRUCTORS CERTIFICATION Expertly trained and deeply rooted in Apply skills to real-world use cases, in everything Elastic real-time Who should attend? Software Developers, Engineers, Data Architects, System Administrators, DevOps What will I learn? ● How to manage deployments and develop solutions. ● Advanced cluster management techniques, best practices for capacity planning and scaling, and more. 50% discount on the 2nd seat - discount until Feb 24th

Slide 41

Slide 41

ElasticFR https://community.elastic.co/ @elasticfr discuss.elastic.co