Apache Pulsar
by Apache Software Foundation
Distributed messaging and streaming platform with multi-tenancy and tiered storage, consumed with client libraries.
- Category
- Cloud & Data Platforms
- Type
- Streaming & messaging
- Interface
- SDK
- Built with
- Connect Anything
- Credentials
- Signed JWT, OAuth 2.0
02Data
What you can sync.
- Topic messages
- Topics
- Subscriptions
Put Apache Pulsar topic messages next to revenue and usage, so every cost has an owner and a reason.
Need more? Name any other Apache Pulsar data the API returns, and the AI adds it to the connector.
03Credentials
Credentials you will need.
- A signed JWT
- OAuth 2.0 (client ID, client secret, refresh token)
Apache Pulsar uses a signed JWT or OAuth 2.0 (client ID, client secret, refresh token). You add the credentials once, when the AI asks for them, and it tells you where to create them in Apache Software Foundation if you need help.
04How it works
How it works in DataMind.
-
Pick Apache Pulsar.
Open Lake, pick Apache Pulsar in the source picker and name the connection. Connect Anything opens with a ready prompt that points the AI at the Apache Pulsar API docs.
-
Answer a few questions.
The AI reads the Apache Pulsar documentation, then asks which credentials you will use, which data to sync (for example topic messages and topics), whether you want a one-time load or a recurring sync, and which accounts or filters apply.
-
Your data lands in Lake.
The connector agent writes a Python connector for Apache Pulsar, tests it against the live API and shows you sample rows. Then the data loads into your Lake on your schedule, ready for the Warehouse, DataPrism BI and AI Minds.
05Related
