일 | 월 | 화 | 수 | 목 | 금 | 토 |
---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | 6 | 7 |
8 | 9 | 10 | 11 | 12 | 13 | 14 |
15 | 16 | 17 | 18 | 19 | 20 | 21 |
22 | 23 | 24 | 25 | 26 | 27 | 28 |
29 | 30 | 31 |
Tags
- Python
- MySQL
- aggs
- token filter test
- Kafka
- zip 파일 암호화
- plugin
- query
- Java
- 차트
- ELASTIC
- docker
- Mac
- sort
- matplotlib
- flask
- API
- licence delete curl
- springboot
- license delete
- Test
- analyzer test
- high level client
- TensorFlow
- 파이썬
- Elasticsearch
- zip 암호화
- 900gle
- aggregation
- License
Archives
- Today
- Total
개발잡부
[markdown] README.md 파일 수정 본문
반응형
900gle shopping README 파일을 변경해야겠음..
컨셉은 블로그와 README 의 동기화 였으나.. 메뉴가 다른것들이 있음
readme를 좀 더 있어보이게 만들어줄 아이템 Hits
기존뱃지 옆에 히트뱃지를 붙여보자
접속 해서
Target URL 만 입력해주면 끝. readme에 추가해보자
이야... 티도 안나네..
900gle README.md
# 900gle shopping (phase2)
[![Elastic Stack version](https://img.shields.io/badge/Elasticsearch-7.15.1-00bfb3?style=flat&logo=elastic-stack)]()
[![Elastic Stack version](https://img.shields.io/badge/kibana-7.15.1-00bfb3?style=flat&logo=elastic-stack)]()
[![Elastic Stack version](https://img.shields.io/badge/logstash-7.15.1-00bfb3?style=flat&logo=elastic-stack)]()
[![Hits](https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2F900gle%2F900gle&count_bg=%2379C83D&title_bg=%23555555&icon=&icon_color=%23E7E7E7&title=hits&edge_flat=false)](https://hits.seeyoufarm.com)
## What is 900gle shopping?
백터의 유사도 검색을 활용한 쇼핑플랫폼 개인프로젝트
[개발잡부](https://ldh-6019.tistory.com)의 블로그의 내용을 구현
#### 개발환경
* macOS
* java 14
* python 3.7.9
* elasticsearch 7.15.1
* kibana 7.15.1
* logstash 7.15.1
* tensorflow 2.14
* OpenCV4.5.0
* MySql
* anaconda
* docker compose
---
## - Architecture - [phase2](https://ldh-6019.tistory.com/132?category=1046444)
[![phase4](https://img1.daumcdn.net/thumb/R1280x0/?scode=mtistory2&fname=https%3A%2F%2Fblog.kakaocdn.net%2Fdn%2FoQCBK%2FbtsdgT1lXhO%2FX911wCdT0y5JLKx9EQgiQk%2Fimg.png)](https://ldh-6019.tistory.com/132?category=1046444)
## - Project directory structure
> docker
> > elastic-stack
>>> elasticsearch
>kibana
>logstash
>
> > kafka
> java
> > doo
> > >api
common
consumer
crawler
indexer
extract
libs
manage
producer
web
>
> python
> >tf-embeddings
>>>api
## - Project discription
1. docker : Elastic stack 관련 DockerFile 및 플러그인 파일
* docker
* elastic-stack
* [elasticsearch](https://ldh-6019.tistory.com/category/ElasticStack/Elasticsearch)
* extensions
* [kibana](https://ldh-6019.tistory.com/category/ElasticStack/Kibana)
* logstash
* [kafka](https://ldh-6019.tistory.com/category/Kafka)
#### Elasticsearch pluin
>analysis-nori - nori 한글형태소분석 플러그인
doo-plugin-7.15.1.zip - 900gle search plugin
kr-danalyzer-7.15.1.zip - 900gle token filter
payload-score-0.1.zip - payload score plugin
#### Elasticsearch dictionary
>{ES_HOME}/config/stopFilter.txt - 불용어 사전
{ES_HOME}/config/synonymsFilter.txt - 동의어 사전
{ES_HOME}/config/user_dictionary.txt - 사용자정의 사전
Usage
```
# docker-compose.yml 파일이 위한 경로로 이동
$ cd ~/900gle/docker/elastic-stack
# elasticsearch, kibana 빌드/실행
$ docker compose up -d --build
# 실행중인 container 확인
$ dodcker ps -a
# 컨네이너 로그확인
$docker logs <CONTAINER ID or NAME>
# 컨네이너 접속
$docker exec -id <NAME> /bin/bash
#container 정지/삭제
$ docker compose stop
$ docker compose down
#image 확인/삭제
$ docker images
$ docker rmi <IMAGE_ID>
```
kafka Usage
```shell
docker compose -f kafka-full.yml up -d --build
```
1. java : 900gle 프로젝트
* java
* doo : Project root
* [api - 검색 API](https://ldh-6019.tistory.com/category/900gle%20shopping/api)
* common - 공통파일
* [crawler - 웹사이트의 상품정보를 크롤링](https://ldh-6019.tistory.com/category/900gle%20shopping/crawler)
* [extract - 크롤링 후 데이터 파일 생성](https://ldh-6019.tistory.com/category/900gle%20shopping/extract)
* [indexer - DB의 내용을 ES에 색인](https://ldh-6019.tistory.com/category/900gle%20shopping/indexer)
* [libs - OpenCV lib 파일](https://ldh-6019.tistory.com/category/OpneCV)
* [manage - Admin 에서 사용될 API (크롤링키워드관리)](https://ldh-6019.tistory.com/category/900gle%20shopping/manage)
* [producer - Kafka producer (카프카 데이터 전송)](https://ldh-6019.tistory.com/category/900gle%20shopping/producer)
* [consumer - Kafka consumer (카프카 데이터 소비)](https://ldh-6019.tistory.com/category/900gle%20shopping/consumer)
* [web - 900gle shopping 웹사이트](https://ldh-6019.tistory.com/category/900gle%20shopping/web)
1. python : tensorflow Text-embedding 모델을 사용하기 위한 API
* python
* tf-embedding
* [app - Text embedding API](https://ldh-6019.tistory.com/185?category=1043090)
Usage
```
#900gle 가상환경 실행
$ conda activate 900gle
#text embedding api 실행
$ python app/api.py
```
---
##Preparation
* [docker 설치](https://ldh-6019.tistory.com/10)
* [docker MySql설치](https://ldh-6019.tistory.com/11)
* [anaconda 설치](https://ldh-6019.tistory.com/117)
* [anaconda tensorflow 설치](https://ldh-6019.tistory.com/118?category=1043090)
반응형
'etc.' 카테고리의 다른 글
[shell] 트래픽 유발자 (0) | 2022.11.18 |
---|---|
화면캡처 - GIPHY CAPTURE (0) | 2022.11.13 |
brakets download (0) | 2022.09.18 |
[mac] mkdir Read-only file system (0) | 2022.08.07 |
Spark install (0) | 2022.06.16 |
Comments