Apache Kafka 1.0 cookbook over 100 practical recipes on using distributed enterprise messaging to handle real-time data
Simplify real-time data processing by leveraging the power of Apache Kafka 1.0 About This Book Use Kafka 1.0 features such as Confluent platforms and Kafka streams to build efficient streaming data applications to handle and process your data Integrate Kafka with other Big Data tools such as Apache...
| Otros Autores: | |
|---|---|
| Formato: | Libro electrónico |
| Idioma: | Inglés |
| Publicado: |
Birmingham, England :
Packt
2017.
|
| Edición: | 1st edition |
| Materias: | |
| Ver en Biblioteca Universitat Ramon Llull: | https://discovery.url.edu/permalink/34CSUC_URL/1im36ta/alma991009630705006719 |
Tabla de Contenidos:
- Cover
- Copyright
- Credits
- About the Author
- About the Reviewers
- www.PacktPub.com
- Customer Feedback
- Dedication
- Table of Contents
- Preface
- Chapter 1: Configuring Kafka
- Introduction
- Installing Kafka
- Getting ready
- How to do it...
- Installing Java in Linux
- Installing Scala in Linux
- Installing Kafka in Linux
- There's more...
- See also
- Running Kafka
- Getting ready
- How to do it...
- There's more...
- See also
- Configuring Kafka brokers
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Configuring Kafka topics
- Getting ready
- How to do it...
- How it works...
- There's more…
- Creating a message console producer
- Getting ready
- How to do it...
- How it works...
- There's more…
- Creating a message console consumer
- Getting ready
- How to do it...
- How it works...
- There's more...
- Configuring the broker settings
- Getting ready
- How to do it...
- How it works…
- There's more…
- Configuring threads and performance
- Getting ready
- How to do it...
- How it works…
- There's more...
- Configuring the log settings
- Getting ready
- How to do it...
- How it works…
- There's more…
- See also
- Configuring the replica settings
- Getting ready
- How to do it...
- How it works…
- There's more...
- Configuring the ZooKeeper settings
- Getting ready
- How to do it…
- How it works…
- See also
- Configuring other miscellaneous parameters
- Getting ready
- How to do it...
- How it works…
- See also
- Chapter 2: Kafka Clusters
- Introduction
- Configuring a single-node single-broker cluster - SNSB
- Getting ready
- How to do it...
- Starting ZooKeeper
- Starting the broker
- How it works...
- There's more...
- See also
- SNSB - creating a topic, producer, and consumer
- Getting ready
- How to do it.
- Creating a topic
- Starting the producer
- Starting the consumer
- How it works...
- There's more...
- Configuring a single-node multiple-broker cluster - SNMB
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- SNMB - creating a topic, producer, and consumer
- Getting ready
- How to do it...
- Creating a topic
- Starting a producer
- Starting a consumer
- How it works...
- There's more...
- See also
- Configuring a multiple-node multiple-broker cluster - MNMB
- Getting ready
- How to do it...
- How it works...
- See also
- Chapter 3: Message Validation
- Introduction
- Modeling the events
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Setting up the project
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Reading from Kafka
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Writing to Kafka
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Running ProcessingApp
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Coding the validator
- Getting ready
- How to do it...
- There's more...
- See also
- Running the validator
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Chapter 4: Message Enrichment
- Introduction
- Geolocation extractor
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Geolocation enricher
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Currency price extractor
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Currency price enricher
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also.
- Running the currency price enricher
- Getting ready
- How to do it...
- How it works...
- Modeling the events
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Setting up the project
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Open weather extractor
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Location temperature enricher
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Running the location temperature enricher
- Getting ready
- How to do it...
- How it works...
- Chapter 5: The Confluent Platform
- Introduction
- Installing the Confluent Platform
- Getting ready
- How to do it...
- There's more...
- See also
- Using Kafka operations
- Getting ready
- How to do it...
- There's more...
- See also
- Monitoring with the Confluent Control Center
- Getting ready
- How to do it...
- How it works...
- There's more...
- Using the Schema Registry
- Getting ready
- How to do it...
- See also
- Using the Kafka REST Proxy
- Getting ready
- How to do it...
- There's more...
- See also
- Using Kafka Connect
- Getting ready
- How to do it...
- There's more...
- See also
- Chapter 6: Kafka Streams
- Introduction
- Setting up the project
- Getting ready
- How to do it...
- How it works...
- Running the streaming application
- Getting ready
- How to do it...
- Chapter 7: Managing Kafka
- Introduction
- Managing consumer groups
- Getting ready
- How to do it...
- How it works...
- Dumping log segments
- Getting ready
- How to do it...
- How it works...
- Importing ZooKeeper offsets
- Getting ready
- How to do it...
- How it works...
- Using the GetOffsetShell
- Getting ready
- How to do it...
- How it works...
- Using the JMX tool.
- Getting ready
- How to do it...
- How it works...
- There's more...
- Using the MirrorMaker tool
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Replaying log producer
- Getting ready
- How to do it...
- How it works...
- Using state change log merger
- Getting ready
- How to do it...
- How it works...
- Chapter 8: Operating Kafka
- Introduction
- Adding or removing topics
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Modifying message topics
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Implementing a graceful shutdown
- Getting ready
- How to do it...
- How it works...
- Balancing leadership
- Getting ready
- How to do it...
- How it works...
- There's more...
- Expanding clusters
- Getting ready
- How to do it...
- How it works...
- There's more...
- Increasing the replication factor
- Getting ready
- How to do it...
- How it works...
- There's more...
- Decommissioning brokers
- Getting ready
- How to do it...
- How it works...
- Checking the consumer position
- Getting ready
- How to do it...
- How it works...
- Chapter 9: Monitoring and Security
- Introduction
- Monitoring server statistics
- Getting ready
- How to do it...
- How it works...
- See also
- Monitoring producer statistics
- Getting ready
- How to do it...
- How it works...
- See also
- Monitoring consumer statistics
- Getting ready
- How to do it...
- How it works...
- See also
- Connecting with the help of Graphite
- Getting ready
- How to do it...
- How it works...
- See also
- Monitoring with the help of Ganglia
- Getting ready
- How to do it...
- How it works...
- See also
- Implementing authentication using SSL
- How to do it...
- See also.
- Implementing authentication using SASL/Kerberos
- How to do it...
- See also
- Chapter 10: Third-Party Tool Integration
- Introduction
- Moving data between Kafka nodes with Flume
- Getting ready
- How to do it...
- How it works...
- See also
- Writing to an HDFS cluster with Gobblin
- Getting ready
- How to do it...
- How it works...
- See also
- Moving data from Kafka to Elastic with Logstash
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Connecting Spark streams and Kafka
- Getting ready
- How to do it...
- How it works...
- There's more...
- Ingesting data from Kafka to Storm
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Pushing data from Kafka to Elastic
- Getting ready
- How to do it...
- How it works...
- See also
- Inserting data from Kafka to SolrCloud
- Getting ready
- How to do it...
- How it works...
- See also
- Building a Kafka producer with Akka
- Getting ready
- How to do it...
- How it works...
- There's more...
- Building a Kafka consumer with Akka
- Getting ready
- How to do it...
- Storing data in Cassandra
- Getting ready
- How to do it...
- How it works...
- Running Kafka on Mesos
- Getting ready
- How to do it...
- How it works...
- There's more...
- Reading Kafka with Apache Beam
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Writing to Kafka from Apache Beam
- Getting ready
- How to do it...
- How it works...
- There's more...
- See also
- Index.
