Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Sign in
Toggle navigation
F
FMS_Project
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
bashar.hussein
FMS_Project
Commits
2d421083
Unverified
Commit
2d421083
authored
May 28, 2023
by
Basharo77
Committed by
GitHub
May 28, 2023
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Add files via upload
parent
ffa263fe
Changes
22
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
22 changed files
with
1150 additions
and
0 deletions
+1150
-0
docker-compose-elk.yaml
Elastic_Configs/docker-compose-elk.yaml
+86
-0
HELP.md
Elastic_Configs/elasticJavaApi/HELP.md
+9
-0
consumer.iml
Elastic_Configs/elasticJavaApi/consumer.iml
+148
-0
mvnw
Elastic_Configs/elasticJavaApi/mvnw
+308
-0
mvnw.cmd
Elastic_Configs/elasticJavaApi/mvnw.cmd
+205
-0
pom.xml
Elastic_Configs/elasticJavaApi/pom.xml
+101
-0
ElasticJavaApiApplication.java
...com/example/elasticJavaApi/ElasticJavaApiApplication.java
+13
-0
elasticConfig.java
...m/example/elasticJavaApi/configuration/elasticConfig.java
+127
-0
application.properties
.../elasticJavaApi/src/main/resources/application.properties
+1
-0
index_template.json
...asticJavaApi/src/main/resources/utils/index_template.json
+10
-0
mappings.json
...igs/elasticJavaApi/src/main/resources/utils/mappings.json
+13
-0
policy.json
...nfigs/elasticJavaApi/src/main/resources/utils/policy.json
+39
-0
settings.json
...igs/elasticJavaApi/src/main/resources/utils/settings.json
+7
-0
ElasticJavaApiApplicationTests.java
...xample/elasticJavaApi/ElasticJavaApiApplicationTests.java
+13
-0
application.properties
...figs/elasticJavaApi/target/classes/application.properties
+1
-0
ElasticJavaApiApplication.class
...om/example/elasticJavaApi/ElasticJavaApiApplication.class
+0
-0
elasticConfig.class
.../example/elasticJavaApi/configuration/elasticConfig.class
+0
-0
index_template.json
...s/elasticJavaApi/target/classes/utils/index_template.json
+10
-0
mappings.json
...Configs/elasticJavaApi/target/classes/utils/mappings.json
+13
-0
policy.json
...c_Configs/elasticJavaApi/target/classes/utils/policy.json
+39
-0
settings.json
...Configs/elasticJavaApi/target/classes/utils/settings.json
+7
-0
ElasticJavaApiApplicationTests.class
...ample/elasticJavaApi/ElasticJavaApiApplicationTests.class
+0
-0
No files found.
Elastic_Configs/docker-compose-elk.yaml
0 → 100644
View file @
2d421083
version
:
'
3'
services
:
es01
:
image
:
elasticsearch:8.7.1
container_name
:
es01
environment
:
-
node.name=es01
-
cluster.name=es.docker.cluster
-
discovery.seed_hosts=es02,es03
-
cluster.initial_master_nodes=es01,es02,es03
-
bootstrap.memory_lock=true
-
"
ES_JAVA_OPTS=-Xms512m
-Xmx512m"
-
xpack.security.enabled=false
ulimits
:
memlock
:
soft
:
-1
hard
:
-1
volumes
:
-
esdata01:/usr/share/elasticsearch/data
ports
:
-
9220:9220
networks
:
-
elastic
es02
:
image
:
elasticsearch:8.7.1
container_name
:
es02
environment
:
-
node.name=es02
-
cluster.name=es.docker.cluster
-
discovery.seed_hosts=es01,es03
-
cluster.initial_master_nodes=es01,es02,es03
-
bootstrap.memory_lock=true
-
"
ES_JAVA_OPTS=-Xms512m
-Xmx512m"
-
xpack.security.enabled=false
ulimits
:
memlock
:
soft
:
-1
hard
:
-1
volumes
:
-
esdata02:/usr/share/elasticsearch/data
networks
:
-
elastic
es03
:
image
:
elasticsearch:8.7.1
container_name
:
es03
environment
:
-
node.name=es03
-
cluster.name=es.docker.cluster
-
discovery.seed_hosts=es01,es02
-
cluster.initial_master_nodes=es01,es02,es03
-
bootstrap.memory_lock=true
-
"
ES_JAVA_OPTS=-Xms512m
-Xmx512m"
-
xpack.security.enabled=false
ulimits
:
memlock
:
soft
:
-1
hard
:
-1
volumes
:
-
esdata03:/usr/share/elasticsearch/data
networks
:
-
elastic
kibana
:
image
:
kibana:8.7.1
container_name
:
kibana2
environment
:
ELASTICSEARCH_URL
:
http://es01:9220
ELASTICSEARCH_HOSTS
:
'
["http://es01:9220",
"http://es02:9200",
"http://es03:9200"]'
ports
:
-
5601:5601
networks
:
-
elastic
volumes
:
esdata01
:
driver
:
local
esdata02
:
driver
:
local
esdata03
:
driver
:
local
networks
:
elastic
:
driver
:
bridge
\ No newline at end of file
Elastic_Configs/elasticJavaApi/HELP.md
0 → 100644
View file @
2d421083
# Getting Started
### Reference Documentation
For further reference, please consider the following sections:
*
[
Official Apache Maven documentation
](
https://maven.apache.org/guides/index.html
)
*
[
Spring Boot Maven Plugin Reference Guide
](
https://docs.spring.io/spring-boot/docs/3.1.0/maven-plugin/reference/html/
)
*
[
Create an OCI image
](
https://docs.spring.io/spring-boot/docs/3.1.0/maven-plugin/reference/html/#build-image
)
Elastic_Configs/elasticJavaApi/consumer.iml
0 → 100644
View file @
2d421083
This diff is collapsed.
Click to expand it.
Elastic_Configs/elasticJavaApi/mvnw
0 → 100644
View file @
2d421083
This diff is collapsed.
Click to expand it.
Elastic_Configs/elasticJavaApi/mvnw.cmd
0 → 100644
View file @
2d421083
@REM ----------------------------------------------------------------------------
@REM Licensed to the Apache Software Foundation (ASF) under one
@REM or more contributor license agreements. See the NOTICE file
@REM distributed with this work for additional information
@REM regarding copyright ownership. The ASF licenses this file
@REM to you under the Apache License, Version 2.0 (the
@REM "License"); you may not use this file except in compliance
@REM with the License. You may obtain a copy of the License at
@REM
@REM https://www.apache.org/licenses/LICENSE-2.0
@REM
@REM Unless required by applicable law or agreed to in writing,
@REM software distributed under the License is distributed on an
@REM "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
@REM KIND, either express or implied. See the License for the
@REM specific language governing permissions and limitations
@REM under the License.
@REM ----------------------------------------------------------------------------
@REM ----------------------------------------------------------------------------
@REM Apache Maven Wrapper startup batch script, version 3.2.0
@REM
@REM Required ENV vars:
@REM JAVA_HOME - location of a JDK home dir
@REM
@REM Optional ENV vars
@REM MAVEN_BATCH_ECHO - set to 'on' to enable the echoing of the batch commands
@REM MAVEN_BATCH_PAUSE - set to 'on' to wait for a keystroke before ending
@REM MAVEN_OPTS - parameters passed to the Java VM when running Maven
@REM e.g. to debug Maven itself, use
@REM set MAVEN_OPTS=-Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=8000
@REM MAVEN_SKIP_RC - flag to disable loading of mavenrc files
@REM ----------------------------------------------------------------------------
@REM Begin all REM lines with '@' in case MAVEN_BATCH_ECHO is 'on'
@echo off
@REM set title of command window
title %0
@REM enable echoing by setting MAVEN_BATCH_ECHO to 'on'
@if "%MAVEN_BATCH_ECHO%" == "on" echo %MAVEN_BATCH_ECHO%
@REM set %HOME% to equivalent of $HOME
if "%HOME%" == "" (set "HOME=%HOMEDRIVE%%HOMEPATH%")
@REM Execute a user defined script before this one
if not "%MAVEN_SKIP_RC%" == "" goto skipRcPre
@REM check for pre script, once with legacy .bat ending and once with .cmd ending
if exist "%USERPROFILE%\mavenrc_pre.bat" call "%USERPROFILE%\mavenrc_pre.bat" %*
if exist "%USERPROFILE%\mavenrc_pre.cmd" call "%USERPROFILE%\mavenrc_pre.cmd" %*
:skipRcPre
@setlocal
set ERROR_CODE=0
@REM To isolate internal variables from possible post scripts, we use another setlocal
@setlocal
@REM ==== START VALIDATION ====
if not "%JAVA_HOME%" == "" goto OkJHome
echo.
echo Error: JAVA_HOME not found in your environment. >&2
echo Please set the JAVA_HOME variable in your environment to match the >&2
echo location of your Java installation. >&2
echo.
goto error
:OkJHome
if exist "%JAVA_HOME%\bin\java.exe" goto init
echo.
echo Error: JAVA_HOME is set to an invalid directory. >&2
echo JAVA_HOME = "%JAVA_HOME%" >&2
echo Please set the JAVA_HOME variable in your environment to match the >&2
echo location of your Java installation. >&2
echo.
goto error
@REM ==== END VALIDATION ====
:init
@REM Find the project base dir, i.e. the directory that contains the folder ".mvn".
@REM Fallback to current working directory if not found.
set MAVEN_PROJECTBASEDIR=%MAVEN_BASEDIR%
IF NOT "%MAVEN_PROJECTBASEDIR%"=="" goto endDetectBaseDir
set EXEC_DIR=%CD%
set WDIR=%EXEC_DIR%
:findBaseDir
IF EXIST "%WDIR%"\.mvn goto baseDirFound
cd ..
IF "%WDIR%"=="%CD%" goto baseDirNotFound
set WDIR=%CD%
goto findBaseDir
:baseDirFound
set MAVEN_PROJECTBASEDIR=%WDIR%
cd "%EXEC_DIR%"
goto endDetectBaseDir
:baseDirNotFound
set MAVEN_PROJECTBASEDIR=%EXEC_DIR%
cd "%EXEC_DIR%"
:endDetectBaseDir
IF NOT EXIST "%MAVEN_PROJECTBASEDIR%\.mvn\jvm.config" goto endReadAdditionalConfig
@setlocal EnableExtensions EnableDelayedExpansion
for /F "usebackq delims=" %%a in ("%MAVEN_PROJECTBASEDIR%\.mvn\jvm.config") do set JVM_CONFIG_MAVEN_PROPS=!JVM_CONFIG_MAVEN_PROPS! %%a
@endlocal & set JVM_CONFIG_MAVEN_PROPS=%JVM_CONFIG_MAVEN_PROPS%
:endReadAdditionalConfig
SET MAVEN_JAVA_EXE="%JAVA_HOME%\bin\java.exe"
set WRAPPER_JAR="%MAVEN_PROJECTBASEDIR%\.mvn\wrapper\maven-wrapper.jar"
set WRAPPER_LAUNCHER=org.apache.maven.wrapper.MavenWrapperMain
set WRAPPER_URL="https://repo.maven.apache.org/maven2/org/apache/maven/wrapper/maven-wrapper/3.2.0/maven-wrapper-3.2.0.jar"
FOR /F "usebackq tokens=1,2 delims==" %%A IN ("%MAVEN_PROJECTBASEDIR%\.mvn\wrapper\maven-wrapper.properties") DO (
IF "%%A"=="wrapperUrl" SET WRAPPER_URL=%%B
)
@REM Extension to allow automatically downloading the maven-wrapper.jar from Maven-central
@REM This allows using the maven wrapper in projects that prohibit checking in binary data.
if exist %WRAPPER_JAR% (
if "%MVNW_VERBOSE%" == "true" (
echo Found %WRAPPER_JAR%
)
) else (
if not "%MVNW_REPOURL%" == "" (
SET WRAPPER_URL="%MVNW_REPOURL%/org/apache/maven/wrapper/maven-wrapper/3.2.0/maven-wrapper-3.2.0.jar"
)
if "%MVNW_VERBOSE%" == "true" (
echo Couldn't find %WRAPPER_JAR%, downloading it ...
echo Downloading from: %WRAPPER_URL%
)
powershell -Command "&{"^
"$webclient = new-object System.Net.WebClient;"^
"if (-not ([string]::IsNullOrEmpty('%MVNW_USERNAME%') -and [string]::IsNullOrEmpty('%MVNW_PASSWORD%'))) {"^
"$webclient.Credentials = new-object System.Net.NetworkCredential('%MVNW_USERNAME%', '%MVNW_PASSWORD%');"^
"}"^
"[Net.ServicePointManager]::SecurityProtocol = [Net.SecurityProtocolType]::Tls12; $webclient.DownloadFile('%WRAPPER_URL%', '%WRAPPER_JAR%')"^
"}"
if "%MVNW_VERBOSE%" == "true" (
echo Finished downloading %WRAPPER_JAR%
)
)
@REM End of extension
@REM If specified, validate the SHA-256 sum of the Maven wrapper jar file
SET WRAPPER_SHA_256_SUM=""
FOR /F "usebackq tokens=1,2 delims==" %%A IN ("%MAVEN_PROJECTBASEDIR%\.mvn\wrapper\maven-wrapper.properties") DO (
IF "%%A"=="wrapperSha256Sum" SET WRAPPER_SHA_256_SUM=%%B
)
IF NOT %WRAPPER_SHA_256_SUM%=="" (
powershell -Command "&{"^
"$hash = (Get-FileHash \"%WRAPPER_JAR%\" -Algorithm SHA256).Hash.ToLower();"^
"If('%WRAPPER_SHA_256_SUM%' -ne $hash){"^
" Write-Output 'Error: Failed to validate Maven wrapper SHA-256, your Maven wrapper might be compromised.';"^
" Write-Output 'Investigate or delete %WRAPPER_JAR% to attempt a clean download.';"^
" Write-Output 'If you updated your Maven version, you need to update the specified wrapperSha256Sum property.';"^
" exit 1;"^
"}"^
"}"
if ERRORLEVEL 1 goto error
)
@REM Provide a "standardized" way to retrieve the CLI args that will
@REM work with both Windows and non-Windows executions.
set MAVEN_CMD_LINE_ARGS=%*
%MAVEN_JAVA_EXE% ^
%JVM_CONFIG_MAVEN_PROPS% ^
%MAVEN_OPTS% ^
%MAVEN_DEBUG_OPTS% ^
-classpath %WRAPPER_JAR% ^
"-Dmaven.multiModuleProjectDirectory=%MAVEN_PROJECTBASEDIR%" ^
%WRAPPER_LAUNCHER% %MAVEN_CONFIG% %*
if ERRORLEVEL 1 goto error
goto end
:error
set ERROR_CODE=1
:end
@endlocal & set ERROR_CODE=%ERROR_CODE%
if not "%MAVEN_SKIP_RC%"=="" goto skipRcPost
@REM check for post script, once with legacy .bat ending and once with .cmd ending
if exist "%USERPROFILE%\mavenrc_post.bat" call "%USERPROFILE%\mavenrc_post.bat"
if exist "%USERPROFILE%\mavenrc_post.cmd" call "%USERPROFILE%\mavenrc_post.cmd"
:skipRcPost
@REM pause the script if MAVEN_BATCH_PAUSE is set to 'on'
if "%MAVEN_BATCH_PAUSE%"=="on" pause
if "%MAVEN_TERMINATE_CMD%"=="on" exit %ERROR_CODE%
cmd /C exit /B %ERROR_CODE%
Elastic_Configs/elasticJavaApi/pom.xml
0 → 100644
View file @
2d421083
<?xml version="1.0" encoding="UTF-8"?>
<project
xmlns=
"http://maven.apache.org/POM/4.0.0"
xmlns:xsi=
"http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation=
"http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd"
>
<modelVersion>
4.0.0
</modelVersion>
<parent>
<groupId>
org.springframework.boot
</groupId>
<artifactId>
spring-boot-starter-parent
</artifactId>
<version>
3.0.4
</version>
<relativePath/>
<!-- lookup parent from repository -->
</parent>
<groupId>
com.example
</groupId>
<artifactId>
consumer
</artifactId>
<version>
0.0.1-SNAPSHOT
</version>
<name>
consumer
</name>
<description>
Demo project for Spring Boot
</description>
<properties>
<java.version>
17
</java.version>
</properties>
<dependencies>
<dependency>
<groupId>
org.springframework.boot
</groupId>
<artifactId>
spring-boot-starter-web
</artifactId>
</dependency>
<dependency>
<groupId>
org.springframework.kafka
</groupId>
<artifactId>
spring-kafka
</artifactId>
</dependency>
<dependency>
<groupId>
org.springframework.boot
</groupId>
<artifactId>
spring-boot-starter-test
</artifactId>
<scope>
test
</scope>
</dependency>
<dependency>
<groupId>
org.springframework.kafka
</groupId>
<artifactId>
spring-kafka-test
</artifactId>
<scope>
test
</scope>
</dependency>
<dependency>
<groupId>
com.rethinkdb
</groupId>
<artifactId>
rethinkdb-driver
</artifactId>
<version>
2.4.0
</version>
</dependency>
<dependency>
<groupId>
io.projectreactor
</groupId>
<artifactId>
reactor-core
</artifactId>
</dependency>
<dependency>
<groupId>
com.google.code.gson
</groupId>
<artifactId>
gson
</artifactId>
<version>
2.8.9
</version>
</dependency>
<dependency>
<groupId>
org.springframework.boot
</groupId>
<artifactId>
spring-boot-starter-websocket
</artifactId>
</dependency>
<dependency>
<groupId>
org.springframework
</groupId>
<artifactId>
spring-messaging
</artifactId>
<version>
5.3.9
</version>
</dependency>
<dependency>
<groupId>
com.google.code.gson
</groupId>
<artifactId>
gson
</artifactId>
<version>
2.8.6
</version>
</dependency>
<dependency>
<groupId>
org.springframework.boot
</groupId>
<artifactId>
spring-boot-starter-data-elasticsearch
</artifactId>
</dependency>
<dependency>
<groupId>
org.projectlombok
</groupId>
<artifactId>
lombok
</artifactId>
<optional>
true
</optional>
</dependency>
<dependency>
<groupId>
javax.persistence
</groupId>
<artifactId>
javax.persistence-api
</artifactId>
<version>
2.2
</version>
</dependency>
<dependency>
<groupId>
co.elastic.clients
</groupId>
<artifactId>
elasticsearch-java
</artifactId>
<version>
8.7.1
</version>
</dependency>
<dependency>
<groupId>
com.fasterxml.jackson.core
</groupId>
<artifactId>
jackson-databind
</artifactId>
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupId>
org.springframework.boot
</groupId>
<artifactId>
spring-boot-maven-plugin
</artifactId>
</plugin>
</plugins>
</build>
</project>
Elastic_Configs/elasticJavaApi/src/main/java/com/example/elasticJavaApi/ElasticJavaApiApplication.java
0 → 100644
View file @
2d421083
package
com
.
example
.
elasticJavaApi
;
import
org.springframework.boot.SpringApplication
;
import
org.springframework.boot.autoconfigure.SpringBootApplication
;
@SpringBootApplication
public
class
ElasticJavaApiApplication
{
public
static
void
main
(
String
[]
args
)
{
SpringApplication
.
run
(
ElasticJavaApiApplication
.
class
,
args
);
}
}
Elastic_Configs/elasticJavaApi/src/main/java/com/example/elasticJavaApi/configuration/elasticConfig.java
0 → 100644
View file @
2d421083
package
com
.
example
.
elasticJavaApi
.
configuration
;
import
co.elastic.clients.elasticsearch.ElasticsearchClient
;
import
co.elastic.clients.elasticsearch._types.Time
;
import
co.elastic.clients.elasticsearch.cat.component_templates.ComponentTemplate
;
import
co.elastic.clients.elasticsearch.cluster.PutComponentTemplateRequest
;
import
co.elastic.clients.elasticsearch.ilm.IlmPolicy
;
import
co.elastic.clients.elasticsearch.ilm.Phase
;
import
co.elastic.clients.elasticsearch.ilm.Phases
;
import
co.elastic.clients.elasticsearch.ilm.PutLifecycleRequest
;
import
co.elastic.clients.elasticsearch.indices.CreateDataStreamRequest
;
import
co.elastic.clients.elasticsearch.indices.IndexState
;
import
co.elastic.clients.elasticsearch.indices.IndexTemplate
;
import
co.elastic.clients.elasticsearch.indices.PutIndexTemplateRequest
;
import
co.elastic.clients.elasticsearch.indices.put_index_template.IndexTemplateMapping
;
import
co.elastic.clients.elasticsearch.security.put_privileges.Actions
;
import
co.elastic.clients.elasticsearch.transform.Settings
;
import
co.elastic.clients.json.JsonData
;
import
co.elastic.clients.json.JsonpDeserializer
;
import
co.elastic.clients.json.JsonpMapper
;
import
co.elastic.clients.json.jackson.JacksonJsonpMapper
;
import
co.elastic.clients.transport.ElasticsearchTransport
;
import
co.elastic.clients.transport.rest_client.RestClientTransport
;
import
com.fasterxml.jackson.core.JsonProcessingException
;
import
com.fasterxml.jackson.databind.JsonNode
;
import
com.fasterxml.jackson.databind.ObjectMapper
;
import
jakarta.annotation.PostConstruct
;
import
jakarta.json.Json
;
import
jakarta.json.JsonValue
;
import
jakarta.json.stream.JsonGenerator
;
import
org.apache.http.HttpHost
;
import
org.elasticsearch.client.RestClient
;
import
org.springframework.context.annotation.Configuration
;
import
java.io.FileNotFoundException
;
import
java.io.FileReader
;
import
java.io.IOException
;
import
java.io.Reader
;
import
java.lang.reflect.Type
;
import
java.nio.file.Files
;
import
java.nio.file.Paths
;
import
java.util.ArrayList
;
import
java.util.HashMap
;
import
java.util.List
;
import
java.util.Map
;
@Configuration
public
class
elasticConfig
{
private
RestClient
restClient
=
RestClient
.
builder
(
new
HttpHost
(
"localhost"
,
9200
)).
build
();
// Create the transport with a Jackson mapper
private
ElasticsearchTransport
transport
=
new
RestClientTransport
(
restClient
,
new
JacksonJsonpMapper
());
// And create the API client
private
final
ElasticsearchClient
elasticClient
=
new
ElasticsearchClient
(
transport
);
public
void
addPolicy
(
String
path
,
String
name
){
FileReader
r
=
null
;
try
{
r
=
new
FileReader
(
path
);
}
catch
(
FileNotFoundException
e
)
{
throw
new
RuntimeException
(
e
);
}
IlmPolicy
plc
=
new
IlmPolicy
.
Builder
().
withJson
(
r
).
build
();
PutLifecycleRequest
policyReq
=
new
PutLifecycleRequest
.
Builder
().
name
(
name
).
policy
(
plc
).
build
();
try
{
elasticClient
.
ilm
().
putLifecycle
(
policyReq
);
}
catch
(
IOException
e
)
{
throw
new
RuntimeException
(
e
);
}
}
public
void
addComponent
(
String
path
,
String
name
){
FileReader
r
=
null
;
try
{
r
=
new
FileReader
(
path
);
}
catch
(
FileNotFoundException
e
)
{
throw
new
RuntimeException
(
e
);
}
IndexState
indexState
=
new
IndexState
.
Builder
().
withJson
(
r
).
build
();
PutComponentTemplateRequest
putComponentTemplateRequest
=
new
PutComponentTemplateRequest
.
Builder
()
.
name
(
name
)
.
template
(
indexState
).
build
();
try
{
elasticClient
.
cluster
().
putComponentTemplate
(
putComponentTemplateRequest
);
}
catch
(
IOException
e
)
{
throw
new
RuntimeException
(
e
);
}
}
public
void
addIndexTemplate
(
String
path
,
String
name
){
FileReader
r
=
null
;
try
{
r
=
new
FileReader
(
path
);
}
catch
(
FileNotFoundException
e
)
{
throw
new
RuntimeException
(
e
);
}
// IndexTemplate indexTemplate = new IndexTemplate.Builder().withJson(r).build();
// IndexTemplateMapping indexTemplateMapping = new IndexTemplateMapping.Builder().withJson(r).build();
PutIndexTemplateRequest
putIndexTemplateRequest
=
new
PutIndexTemplateRequest
.
Builder
()
.
withJson
(
r
)
.
name
(
name
)
.
build
();
try
{
elasticClient
.
indices
().
putIndexTemplate
(
putIndexTemplateRequest
);
}
catch
(
IOException
e
)
{
throw
new
RuntimeException
(
e
);
}
}
public
void
addDataStream
(
String
name
){
CreateDataStreamRequest
createDataStreamRequest
=
new
CreateDataStreamRequest
.
Builder
()
.
name
(
name
).
build
();
try
{
elasticClient
.
indices
().
createDataStream
(
createDataStreamRequest
);
}
catch
(
IOException
e
)
{
throw
new
RuntimeException
(
e
);
}
}
@PostConstruct
public
void
ElasticDataStreamConfig
()
throws
JsonProcessingException
,
FileNotFoundException
{
addPolicy
(
"src/main/resources/utils/policy.json"
,
"Bashar"
);
addComponent
(
"src/main/resources/utils/settings.json"
,
"bashar_setting"
);
addComponent
(
"src/main/resources/utils/mappings.json"
,
"bashar_mapping"
);
addIndexTemplate
(
"src/main/resources/utils/index_template.json"
,
"bashar_template"
);
addDataStream
(
"bashar-data-stream-2"
);
}
}
Elastic_Configs/elasticJavaApi/src/main/resources/application.properties
0 → 100644
View file @
2d421083
Elastic_Configs/elasticJavaApi/src/main/resources/utils/index_template.json
0 → 100644
View file @
2d421083
{
"index_patterns"
:
[
"bashar-data-stream*"
],
"data_stream"
:
{
},
"composed_of"
:
[
"bashar_setting"
,
"bashar_mapping"
],
"priority"
:
670
,
"_meta"
:
{
"description"
:
"Template for my time series data"
,
"my-custom-meta-field"
:
"More arbitrary metadata"
}
}
\ No newline at end of file
Elastic_Configs/elasticJavaApi/src/main/resources/utils/mappings.json
0 → 100644
View file @
2d421083
{
"mappings"
:
{
"properties"
:
{
"@timestamp"
:
{
"type"
:
"date"
,
"format"
:
"date_optional_time||epoch_millis"
},
"message"
:
{
"type"
:
"wildcard"
}
}
}
}
\ No newline at end of file
Elastic_Configs/elasticJavaApi/src/main/resources/utils/policy.json
0 → 100644
View file @
2d421083
{
"phases"
:
{
"hot"
:
{
"min_age"
:
"0ms"
,
"actions"
:
{
"set_priority"
:
{
"priority"
:
100
},
"rollover"
:
{
"max_primary_shard_size"
:
"50gb"
,
"max_age"
:
"2m"
}
}
},
"warm"
:
{
"min_age"
:
"2m"
,
"actions"
:
{
"set_priority"
:
{
"priority"
:
50
}
}
},
"cold"
:
{
"min_age"
:
"4m"
,
"actions"
:
{
"set_priority"
:
{
"priority"
:
0
}
}
},
"delete"
:
{
"min_age"
:
"6m"
,
"actions"
:
{
"delete"
:
{
}
}
}
}
}
\ No newline at end of file
Elastic_Configs/elasticJavaApi/src/main/resources/utils/settings.json
0 → 100644
View file @
2d421083
{
"settings"
:
{
"index.lifecycle.name"
:
"Bashar"
,
"index.number_of_shards"
:
1
,
"index.number_of_replicas"
:
0
}
}
\ No newline at end of file
Elastic_Configs/elasticJavaApi/src/test/java/com/example/elasticJavaApi/ElasticJavaApiApplicationTests.java
0 → 100644
View file @
2d421083
package
com
.
example
.
elasticJavaApi
;
import
org.junit.jupiter.api.Test
;
import
org.springframework.boot.test.context.SpringBootTest
;
@SpringBootTest
class
ElasticJavaApiApplicationTests
{
@Test
void
contextLoads
()
{
}
}
Elastic_Configs/elasticJavaApi/target/classes/application.properties
0 → 100644
View file @
2d421083
Elastic_Configs/elasticJavaApi/target/classes/com/example/elasticJavaApi/ElasticJavaApiApplication.class
0 → 100644
View file @
2d421083
File added
Elastic_Configs/elasticJavaApi/target/classes/com/example/elasticJavaApi/configuration/elasticConfig.class
0 → 100644
View file @
2d421083
File added
Elastic_Configs/elasticJavaApi/target/classes/utils/index_template.json
0 → 100644
View file @
2d421083
{
"index_patterns"
:
[
"bashar-data-stream*"
],
"data_stream"
:
{
},
"composed_of"
:
[
"bashar_setting"
,
"bashar_mapping"
],
"priority"
:
670
,
"_meta"
:
{
"description"
:
"Template for my time series data"
,
"my-custom-meta-field"
:
"More arbitrary metadata"
}
}
\ No newline at end of file
Elastic_Configs/elasticJavaApi/target/classes/utils/mappings.json
0 → 100644
View file @
2d421083
{
"mappings"
:
{
"properties"
:
{
"@timestamp"
:
{
"type"
:
"date"
,
"format"
:
"date_optional_time||epoch_millis"
},
"message"
:
{
"type"
:
"wildcard"
}
}
}
}
\ No newline at end of file
Elastic_Configs/elasticJavaApi/target/classes/utils/policy.json
0 → 100644
View file @
2d421083
{
"phases"
:
{
"hot"
:
{
"min_age"
:
"0ms"
,
"actions"
:
{
"set_priority"
:
{
"priority"
:
100
},
"rollover"
:
{
"max_primary_shard_size"
:
"50gb"
,
"max_age"
:
"2m"
}
}
},
"warm"
:
{
"min_age"
:
"2m"
,
"actions"
:
{
"set_priority"
:
{
"priority"
:
50
}
}
},
"cold"
:
{
"min_age"
:
"4m"
,
"actions"
:
{
"set_priority"
:
{
"priority"
:
0
}
}
},
"delete"
:
{
"min_age"
:
"6m"
,
"actions"
:
{
"delete"
:
{
}
}
}
}
}
\ No newline at end of file
Elastic_Configs/elasticJavaApi/target/classes/utils/settings.json
0 → 100644
View file @
2d421083
{
"settings"
:
{
"index.lifecycle.name"
:
"Bashar"
,
"index.number_of_shards"
:
1
,
"index.number_of_replicas"
:
0
}
}
\ No newline at end of file
Elastic_Configs/elasticJavaApi/target/test-classes/com/example/elasticJavaApi/ElasticJavaApiApplicationTests.class
0 → 100644
View file @
2d421083
File added
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment