jsbilgi
(Jagannath Bilgi)
1
I’m new to Akka streams, Are there any Scala examples for streaming data from Kafka using Akka Stream and persisting Into Cassandra?
Have downloaded code from git.
However not sure how to proceed further.
Objective is to read csv/json file into Kafka and persist into Cassandra with alpakka
ennru
(Enno)
2
Hi @jsbilgi,
Sounds like a good start with Alpakka!
There is an example for reading from Kafka and writing to Elasticsearch which might help you to get started: https://doc.akka.io/docs/alpakka/current/examples/elasticsearch-samples.html#example-read-from-a-kafka-topic-and-publish-to-elasticsearch
I hope that’s kind of what you were looking for,
Enno.
jsbilgi
(Jagannath Bilgi)
3
Thank you Enno.
Able to fetch from site using http. It worked for “http://samplecsvs.s3.amazonaws.com/SalesJan2009.csv?render=download” properly.
However it failed to get response from “https://www.nasdaq.com/screening/companies-by-name.aspx?exchange=AMEX&render=download” site mentioned in example.
It failed at mapAsync(1)(Http().singleRequest(_)). Below is the error message
“dead letters encountered”
From browser able to download file from site. It is working.
Also checked with another site. There able to get data from http. However output is jumbled.
Below is site
https://sample-videos.com/csv/Sample-Spreadsheet-10-rows.csv