Click here to load reader

Amazon Search Services - Amazon Web Servicesaws-de-media.s3.amazonaws.com/...Search_Intro... · AWS SDK AWS CLI AWS Console Build on your preferred language: Java, Ruby, Python, and

  • View
    0

  • Download
    0

Embed Size (px)

Text of Amazon Search Services - Amazon Web Servicesaws-de-media.s3.amazonaws.com/...Search_Intro... · AWS...

  • Christoph [email protected]

    Amazon Search Services

  • What we'll cover

    • Overview of Amazon Search Services• Understand the difference between

    Cloudsearch and Amazon ElasticSearchService

    • Q&A

  • Amazon Search Services

    Amazon CloudSearch

    Amazon Elasticsearch

    Service

  • Scenario: Full-text search

    • Traditional search

    • Your application or website provides search capabilities over diverse documents

    • You are tasked with making this knowledge base searchable and accessible

    • You need key search features including text matching, faceting, filtering, fuzzy search, auto complete, and highlighting

  • Scenario: Log data analytics

    • Application monitoring and event diagnosis

    • You need to monitor the performance of your application, web servers, and hardware

    • You need easy to use, yet powerful data visualization tools to detect issues in near real-time

    • You want the ability to dig into your logs in an intuitive, fine-grained way

  • Scenario: Batch data analytics

    • Usage Monitoring

    • You are a mobile app developer• You have to monitor/manage users

    across multiple app versions• You want to analyze and report on

    usage and migration between app versions

  • Search is like a database

    SearchValueField

    DocumentIndex

    Cluster

    Queries

    DatabaseValueColumnRowTableDatabase

    SQL

  • Search is not like a database

    Search• No relational information• No transactions• Eventual consistency• Queries bring the best

    matches• Sorting based on relevance• Read-heavy, highly

    distributed

    Database• Relational information• Transactions• Strong consistency model• Queries bring all matches• Sorting based on field

    values

  • Amazon CloudSearch is a fully managed search service in the cloud for your website or application

  • Rich search feature set

    Source:IDC,Nielsen, Twitterblog

    Faceting Highlighting Autocompletesuggestions

    Geospatial search

  • Ease of operation

    Auto-scaling

    Highavailability

    Self-healingclusters

    Datadurability

  • Easy administration

    Security built-in integration with

    AWS IAM

    Monitoringbuilt-in integration withAmazon CloudWatch

    Auditingbuilt-in integration with

    AWS CloudTrail

  • Flexible options to build, automate, and experiment

    AWS SDK

    AWS CLI

    AWS Console

    Build on your preferred

    language: Java, Ruby, Python,

    and many more

    Automate admin tasks by

    scripting via the command-line

    interface

    Experiment with easy-to-use, interactive console gui

  • Pay only for the resources you use

    Instance hours Index buildsBatch uploads

  • Amazon CloudSearch is great if…

    ü Your application is high-read / low-write, requires fast query performance, but moderate document updates

    - Example use cases: website search, e-Commerce search

    ü You are looking for a hands-free search platform that takes care of scaling, high availability, data durability, and other administrative tasks

    ü You want to focus on your business as opposed to building search expertise

  • Amazon Elasticsearch Service

  • The ELK stack for visualization

    • Combined with Logstash and Kibana, the ELK stack provides a tool for real-time analytics and data visualization

  • Scenario: Full-text search

    • Traditional search

    • Your application or website provides search capabilities over diverse documents

    • You are tasked with making this knowledge base searchable and accessible

    • You need key search features including text matching, faceting, filtering, fuzzy search, auto complete, and highlighting

  • Ease of operation

    Highavailability

    Self-healingclusters

    Datadurability

    Easy cluster creation and configuration management

  • Easy administration

    Security built-in integration with

    AWS IAM

    Monitoringbuilt-in integration withAmazon CloudWatch

    Auditingbuilt-in integration with

    AWS CloudTrail

  • Logstash

    REST

    CWL Agent

    EC2 Instances

    Amazon Kinesis

    AmazonRDS

    AmazonDynamoDB

    AmazonSQS

    Queue

    LogstashCluster

    Amazon Elasticsearch

    Service

    Amazon CloudWatch

    AWSLambda

    AWSCloudTrail

    Access Logs

    Amazon VPC Flow

    Logs

    Amazon S3 bucket

    AWS IoT

    Amazon Kinesis Firehose

    Integration with the AWS ecosystem

  • Pay for compute and storage you use

    • With Amazon Elasticsearch Service, you pay only for the compute and storage resources you use. AWS Free Tier for qualifying customers.

  • Amazon Elasticsearch Service• Elk – +Kibana• High volume updates• More storage at lower cost• Multi-tenant workloads• Nested documents• Aggregations

    Two Search Technologies? Strengths of each

    Amazon CloudSearch• Hands-off operation• Simple API for search• Simple schema changes• Relevance tuning

  • Q&A

    • Christoph Schmitter: [email protected] Architect

    • https://run.qwiklab.com/searches/elasticsearch• Building Search into your Applications with

    Amazon CloudSearch•

  • Demo Optional

    Kibana