4IR Technical Center

김도영 (Kim Do Young)
[email protected]

 

EC2 Intances

Ssh –I /key가있는경로/keyname.pem [email protected]인스턴스의 퍼블릭DNS


GENERATE DATA TO KINESIS AGENT
Sudo vi /etc/aws-kinesis-agent start  (데이터 발생 시작)
Python  /home/ec2-user/generator.py  & (백그라운드에서 스크립트 수집)
Cd /tmp/clickstream-log (파일 들어가기)
ls –ll(json 파일 내용 보기)


Data Collection

Kinesis

Fully managed service

Used when collecting data (Data Firehose)

Serverless way

Easily capture streaming data

Loading data into S3, ES, etc.

Data preprocessing using Lambda

Autoscaling based on data throughput

 


NETWORK

Categories: Portfolio

0 Comments

Leave a Reply

Avatar placeholder

Your email address will not be published.