• Elasticsearch搜索引擎的入门实战


    1.ES的背景:

    ElasticSearch是一个基于Lucene的搜索服务器。它提供了一个分布式多用户能力的全文搜索引擎,基于RESTful web接口。Elasticsearch是用Java开发的,并作为Apache许可条款下的开放源码发布,是当前流行的企业级搜索引擎。设计用于云计算中,能够达到实时搜索,稳定,可靠,快速,安装使用方便。官方客户端在Java、.NET(C#)、PHP、Python、Apache Groovy、Ruby和许多其他语言中都是可用的。根据DB-Engines的排名显示,Elasticsearch是最受欢迎的企业搜索引擎,其次是Apache Solr,也是基于Lucene。

    2.注意事项:ElasticSearch的版本跟ElasticSearch的客户端要保持一致的版本,另外不同版本的客户端,他们的编码风格也不一致。ElasticSearch7.0的版本跟以往的版本风格是不一样的,详细的可以查看官方文档

    3.这里用到的工具有idea,ElasticSearch7.2,跟es的Java High Level REST Client,要了解Java High Level REST Client客户端的api,可以到看这个文档。基于ssm框架来实现一个简单的,结合mysql和es的增删改查。

    4.可以用ES官网中的Kibana工具,来实现对ES API的操作。如果需要配置多个ES;

    5.ES中的conf/elasticsearch.yml对其修改,在下面添加修改:

    这是一个主节点的配置

    http.cors.enabled: true
    http.cors.allow-origin: "*"
    cluster.name: xiao
    node.name: slave
    node.master: true
    network.host: 127.0.0.1

    配置第二个节点

    cluster.name: xiao
    node.name: slave1
    network.host: 127.0.0.1
    http.port: 8200

    配置第三个节点

    cluster.name: xiao
    node.name: slave2
    network.host: 127.0.0.1
    http.port: 7200
    discovery.zen.ping.unicast.hosts: ["127.0.0.1"]

    6.也可以配一个Elasticsearch-head来看集群中的内容:

    1.pom:

    <?xml version="1.0" encoding="UTF-8"?>
    <project xmlns="http://maven.apache.org/POM/4.0.0"
             xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
             xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
        <modelVersion>4.0.0</modelVersion>
    
        <groupId>com.zhongmin</groupId>
        <artifactId>zhongDemo</artifactId>
        <version>1.0-SNAPSHOT</version>
        <packaging>war</packaging>
        <dependencies>
            <!-- https://mvnrepository.com/artifact/log4j/log4j -->
            <dependency>
                <groupId>log4j</groupId>
                <artifactId>log4j</artifactId>
                <version>1.2.17</version>
            </dependency>
    
            <dependency>
                <groupId>ch.qos.logback</groupId>
                <artifactId>logback-core</artifactId>
                <version>1.1.1</version>
                <scope>provided</scope>
            </dependency>
            <!--实现slf4j接口并整合-->
            <dependency>
                <groupId>ch.qos.logback</groupId>
                <artifactId>logback-classic</artifactId>
                <version>1.1.1</version>
                <scope>provided</scope>
            </dependency>
            <dependency>
                <groupId>com.oracle</groupId>
                <artifactId>ojdbc</artifactId>
                <version>6</version>
            </dependency>
            <!--druid==>阿里巴巴数据库连接池-->
            <dependency>
                <groupId>com.alibaba</groupId>
                <artifactId>druid</artifactId>
                <version>1.0.25</version>
            </dependency>
            <!--2.dao框架:MyBatis依赖-->
            <dependency>
                <groupId>org.mybatis</groupId>
                <artifactId>mybatis</artifactId>
                <version>3.3.0</version>
            </dependency>
            <!--mybatis自身实现的spring整合依赖-->
            <dependency>
                <groupId>org.mybatis</groupId>
                <artifactId>mybatis-spring</artifactId>
                <version>1.3.2</version>
            </dependency>
    
            <!--3.Servlet web相关依赖-->
            <dependency>
                <groupId>taglibs</groupId>
                <artifactId>standard</artifactId>
                <version>1.1.2</version>
            </dependency>
            <dependency>
                <groupId>jstl</groupId>
                <artifactId>jstl</artifactId>
                <version>1.2</version>
    
            </dependency>
            <dependency>
                <groupId>com.fasterxml.jackson.core</groupId>
                <artifactId>jackson-databind</artifactId>
                <version>2.5.4</version>
            </dependency>
    
            <dependency>
                <groupId>javax.servlet</groupId>
                <artifactId>javax.servlet-api</artifactId>
                <version>3.1.0</version>
                <scope>provided</scope>
            </dependency>
    
            <!--4:spring依赖-->
            <!--1)spring核心依赖-->
            <dependency>
                <groupId>org.springframework</groupId>
                <artifactId>spring-core</artifactId>
                <version>4.3.14.RELEASE</version>
            </dependency>
            <dependency>
                <groupId>org.springframework</groupId>
                <artifactId>spring-beans</artifactId>
                <version>4.3.14.RELEASE</version>
            </dependency>
            <dependency>
                <groupId>org.springframework</groupId>
                <artifactId>spring-context</artifactId>
                <version>4.3.14.RELEASE</version>
            </dependency>
            <!--2)spring dao层依赖-->
            <dependency>
                <groupId>org.springframework</groupId>
                <artifactId>spring-jdbc</artifactId>
                <version>4.3.14.RELEASE</version>
            </dependency>
            <dependency>
                <groupId>org.springframework</groupId>
                <artifactId>spring-tx</artifactId>
                <version>4.3.14.RELEASE</version>
            </dependency>
            <!--3)springweb相关依赖-->
            <dependency>
                <groupId>org.springframework</groupId>
                <artifactId>spring-web</artifactId>
                <version>4.3.14.RELEASE</version>
            </dependency>
            <dependency>
                <groupId>org.springframework</groupId>
                <artifactId>spring-webmvc</artifactId>
                <version>4.3.14.RELEASE</version>
            </dependency>
            <!--4)spring test相关依赖-->
            <dependency>
                <groupId>org.springframework</groupId>
                <artifactId>spring-test</artifactId>
                <version>4.3.14.RELEASE</version>
            </dependency>
            <dependency>
                <groupId>mysql</groupId>
                <artifactId>mysql-connector-java</artifactId>
                <version>5.1.35</version>
                <scope>runtime</scope>
            </dependency>
    
            <!--Aop要导入的包-->
            <dependency>
                <groupId>org.aspectj</groupId>
                <artifactId>aspectjweaver</artifactId>
                <version>1.8.9</version>
            </dependency>
    
            <dependency>
                <groupId>org.json</groupId>
                <artifactId>json</artifactId>
                <version>20170516</version>
            </dependency>
            <!-- https://mvnrepository.com/artifact/com.fasterxml.jackson.core/jackson-core -->
            <dependency>
                <groupId>com.fasterxml.jackson.core</groupId>
                <artifactId>jackson-core</artifactId>
                <version>2.9.8</version>
            </dependency>
    
            <!-- ElasticSearch核心包 -->
            <!-- https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch -->
            <dependency>
                <groupId>org.elasticsearch</groupId>
                <artifactId>elasticsearch</artifactId>
                <version>7.2.0</version>
            </dependency>
    
            <dependency>
                <groupId>org.elasticsearch.client</groupId>
                <artifactId>elasticsearch-rest-high-level-client</artifactId>
                <version>7.2.0</version>
            </dependency>
            <dependency>
                <groupId>junit</groupId>
                <artifactId>junit</artifactId>
                <version>4.12</version>
            </dependency>
    
    
    
        </dependencies>
        <build>
            <plugins>
                <plugin>
                    <groupId>org.apache.maven.plugins</groupId>
                    <artifactId>maven-compiler-plugin</artifactId>
                    <configuration>
                        <source>1.8</source>
                        <target>1.8</target>
                    </configuration>
                </plugin>
                <plugin>
                    <groupId>org.apache.maven.plugins</groupId>
                    <artifactId>maven-war-plugin</artifactId>
                    <version>2.6</version>
                    <configuration>
                        <includeEmptyDirectories>true</includeEmptyDirectories>
                    </configuration>
                </plugin>
    
            </plugins>
        </build>
    
    </project>

    2.es客户端连接集群:

    package com.xiaoqiang.servic.impl;
    
    import com.xiaoqiang.dao.CompanyDao;
    import com.xiaoqiang.entiy.Company;
    import com.xiaoqiang.servic.search.CompanyIndexservic;
    
    import com.xiaoqiang.util.CompanyKey;
    import com.xiaoqiang.util.InitDemo;
    import org.apache.lucene.search.TotalHits;
    import org.elasticsearch.action.DocWriteResponse;
    import org.elasticsearch.action.index.IndexRequest;
    import org.elasticsearch.action.index.IndexResponse;
    import org.elasticsearch.action.search.SearchRequest;
    import org.elasticsearch.action.search.SearchResponse;
    import org.elasticsearch.action.update.UpdateRequest;
    import org.elasticsearch.action.update.UpdateResponse;
    import org.elasticsearch.client.RequestOptions;
    import org.elasticsearch.client.RestHighLevelClient;
    import org.elasticsearch.index.query.QueryBuilders;
    import org.elasticsearch.index.query.TermQueryBuilder;
    import org.elasticsearch.index.reindex.BulkByScrollResponse;
    import org.elasticsearch.index.reindex.DeleteByQueryRequest;
    import org.elasticsearch.search.SearchHits;
    import org.elasticsearch.search.builder.SearchSourceBuilder;
    import org.slf4j.Logger;
    import org.slf4j.LoggerFactory;
    import org.springframework.beans.factory.annotation.Autowired;
    import org.springframework.stereotype.Service;
    
    import java.io.IOException;
    import java.util.HashMap;
    import java.util.Map;
    @Service
    public class CompanyIndexservicImpl implements CompanyIndexservic {
        private static final Logger logger = LoggerFactory.getLogger(CompanyIndexservic.class);
        private static final String INDEX_NAME = "mycompany";
    
        private RestHighLevelClient client = InitDemo.getClient();
        @Autowired
        private CompanyDao companyDao;
    
        @Override
        public void index(Long companyId)  {
            Company company = companyDao.findOne(companyId);
            if (company == null) {
                logger.error("Index Company {} does not exist", companyId);
                return;
            }
            SearchRequest searchRequest = new SearchRequest(INDEX_NAME);
            SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
            searchSourceBuilder.query(QueryBuilders.termQuery(CompanyKey.companyId,company.getId()));
            searchRequest.source(searchSourceBuilder);
            SearchResponse searchResponse = null;
            try {
                searchResponse = client.search(searchRequest, RequestOptions.DEFAULT);
            } catch (IOException e) {
                e.printStackTrace();
            }
            logger.debug(searchRequest.toString());
            SearchHits hits = searchResponse.getHits();
            TotalHits totalHits = hits.getTotalHits();
            long numHits = totalHits.value;
            boolean success;
            if(numHits==0)
            {
                success=create(company);
            }
            else if(numHits==1){
                success=update(company);
            }
            else
            {
                success=deleteAndCreate(numHits,company);
            }
            if(success)
            {
                logger.debug("创建索引成功"+company.getId());
            }
        }
    
        private boolean create(Company company)  {
            Map<String, Object> jsonMap = new HashMap<>();
            jsonMap.put(CompanyKey.companyName, company.getCompanyname());
            jsonMap.put(CompanyKey.companyId, company.getId());
            IndexRequest indexRequest = new IndexRequest("mycompany")
                    .id(String.valueOf(company.getId())).source(jsonMap);
            logger.debug("获取公司id=" + company.getId());
            IndexResponse indexResponse = null;
            try {
                indexResponse = client.index(indexRequest, RequestOptions.DEFAULT);
            } catch (IOException e) {
                logger.error("创建失败失败Id=" + company.getId(), e);
            }
            if (indexResponse.getResult() == DocWriteResponse.Result.CREATED) {
                return true;
            } else {
                return false;
            }
    
        }
    
        private boolean update(Company company) {
            Map<String, Object> jsonMap = new HashMap<>();
            jsonMap.put("companyname", company.getCompanyname());
            jsonMap.put("id", company.getId());
            UpdateRequest request = new UpdateRequest(INDEX_NAME, company.getId().toString()).doc(jsonMap);
            UpdateResponse updateResponse = null;
            try {
                updateResponse = client.update(
                        request, RequestOptions.DEFAULT);
            } catch (IOException e) {
                logger.error("更新失败失败Id=" + company.getId(), e);
            }
    
            if (updateResponse.getResult() == DocWriteResponse.Result.UPDATED) {
                return true;
            } else {
                return false;
            }
    
    
        }
    
        private boolean deleteAndCreate(long total, Company company) {
            DeleteByQueryRequest request =
                    new DeleteByQueryRequest(INDEX_NAME);
            request.setQuery(new TermQueryBuilder(CompanyKey.companyId, company.getId()));
            BulkByScrollResponse bulkResponse = null;
            try {
                bulkResponse =
                        client.deleteByQuery(request, RequestOptions.DEFAULT);
                logger.debug("delete company " + bulkResponse);
    
            } catch (IOException e) {
                e.printStackTrace();
            }
            long deleted = bulkResponse.getDeleted();
            if (deleted != total) {
                logger.warn("应该要删除{},但是只删除了{}", total, deleted);
                return false;
            } else {
                return create(company);
            }
    
        }
    
    
        @Override
        public void remvoe(Long companyId) {
            DeleteByQueryRequest request =
                    new DeleteByQueryRequest(INDEX_NAME);
            request.setQuery(new TermQueryBuilder(CompanyKey.companyId,companyId));
            BulkByScrollResponse bulkResponse = null;
            try {
                bulkResponse =
                        client.deleteByQuery(request, RequestOptions.DEFAULT);
                logger.debug("delete company " + bulkResponse);
    
            } catch (IOException e) {
                e.printStackTrace();
            }
    
            long deleted=bulkResponse.getDeleted();
            logger.debug("删除了{}条",deleted);
    
    
        }
    }

    3.获取连接服务的代码:

    package com.xiaoqiang.util;
    
    import org.apache.http.HttpHost;
    import org.elasticsearch.client.RestClient;
    import org.elasticsearch.client.RestHighLevelClient;
    
    
    /**
     * 
     * @Description: 获取Java High Level REST Client客户端
     * @author lgs
     * @date 
     *
     */
    public class InitDemo {
    
        public static RestHighLevelClient getClient() {
    
            RestHighLevelClient client = new RestHighLevelClient(
                    RestClient.builder(
                            new HttpHost("localhost", 9200, "http")));
    
            return client;
        }
    }
  • 相关阅读:
    HDU 4819 Mosaic --二维线段树(树套树)
    Codeforces Round #274 Div.1 C Riding in a Lift --DP
    ZOJ 3829 Known Notation --贪心+找规律
    JAVA成员变量和静态变量的区别
    spring注解
    js中double类型的数据加减的时候出错
    js在页面间传值的方法记录
    将表中数据转换成java entity实例
    最近都写APP的接口,有苦说不出啊.
    写于2018年第一场雪----记我的第一年工作
  • 原文地址:https://www.cnblogs.com/socketqiang/p/11205822.html
Copyright © 2020-2023  润新知