Slides

Es part 2 pdf no build

Description
1. elas ticse g in tro arch m iss in t he r ik R ose by E Part 2: Configuration & Deployment 2. clustering 3. shards curl -XPUT http://localhost:9200/twitter/ -d…
Categories
Published
of 27
All materials on our website are shared by users. If you have any questions about copyright issues, please report us to resolve them. We are always happy to assist you.
Related Documents
Share
Transcript
  • 1. elas ticse g in tro arch m iss in t he r ik R ose by E Part 2: Configuration & Deployment
  • 2. clustering
  • 3. shards curl -XPUT http://localhost:9200/twitter/ -d index: number_of_shards: 3
  • 4. replicas curl -XPUT http://localhost:9200/twitter/ -d index: number_of_shards: 3 number_of_replicas: 2
  • 5. extremer extremes
  • 6. recommendations☁ Have at least 1 replica.☁ Make plenty of shards—but don’t go crazy.☁ 3 discovery.zen.minimum_master_nodes: 2
  • 7. real-life examples
  • 8. too friendly☁ Protect with a firewall☁ discovery.zen.ping.multicast.enabled: false☁ discovery.zen.ping.unicast.hosts: [“master1”, “master2”]☁ cluster.name: something_weird
  • 9. downtime discovery.zen.ping.unicast.hosts: ["a.example.com", "b.example.com"]
  • 10. be wary
  • 11. monitoringcurl -XGET -s http://localhost:9200/_cluster/health?pretty=true{ "cluster_name" : "grinchyelasticsearch", "status" : "yellow", "timed_out" : false, "number_of_nodes" : 1, "number_of_data_nodes" : 1, "active_primary_shards" : 5, "active_shards" : 5, "relocating_shards" : 0, "initializing_shards" : 0, "unassigned_shards" : 5}
  • 12. monitoringhttp://karmi.github.com/elasticsearch-paramedic/
  • 13. optimization
  • 14. bootstrap.mlockall: true
  • 15. ES_HEAP_SIZE: half of RAM
  • 16. open files /etc/security/limits.conf: es_user soft nofile 65535 ✚ es_user hard nofile 65535 /etc/init.d/elasticsearch: ulimit -n 65535 ulimit -l unlimited
  • 17. Use default stores.
  • 18. RAM & JVM tuning
  • 19. shrinking indices% vmstat -S m -a 2procs -----------memory---------- ---swap-- -----io---- r b swpd free inact active si so bi bo 1 0 4 37 54 55 0 0 0 1 0 0 4 37 54 55 0 0 0 0 0 0 4 37 54 55 0 0 0 0 "some_doctype" : { "some_field"{"compress" "_all" : : {"enabled" ::false} : false} "_source"{"enabled" : false} : {"include_in_all" true} }
  • 20. filter caching "filter": { "terms": { "tags": ["red", "green"], "execution": "plain" } } "filter": { "terms": { "tags": ["red", "green"], "execution": "bool" } }
  • 21. dealing with the future
  • 22. mappings
  • 23. expensive updates
  • 24. how to reindex☁ Use Bulk API.☁ Turn off auto-refresh: curl -XPUT localhost:9200/test/_settings -d { "index" : { "refresh_interval" : "-1" } }☁ index.merge.policy.merge_factor: 1000☁ Remove replicas if you can.☁ Use multiple feeder processes.☁ Put everything back.
  • 25. backups☁ Small data: reindex☁ Big data: index.translog.disable_flush = true
  • 26. thank you twitter: ErikRose erik@mozilla.comBackground image by Tim and Julie Wilson: https://secure.flickr.com/photos/secondtree/. This presentation is noncommercial sharealike in accordance with that images license.
  • We Need Your Support
    Thank you for visiting our website and your interest in our free products and services. We are nonprofit website to share and download documents. To the running of this website, we need your help to support us.

    Thanks to everyone for your continued support.

    No, Thanks
    SAVE OUR EARTH

    We need your sign to support Project to invent "SMART AND CONTROLLABLE REFLECTIVE BALLOONS" to cover the Sun and Save Our Earth.

    More details...

    Sign Now!

    We are very appreciated for your Prompt Action!

    x