---
title: "Connectors"
canonical: "https://onesaitplatform.refined.site/space/DOCT/2220821331/Connectors"
format: markdown
---
As you know, the platform's DataFlow is built on the open-source software, [**Streamsets Data Collector**](https://streamsets.com/products/sdc),thus the platform allows to use every component integrated in Streamsets along with the platform's own components integrated in the DataFlow.

In this post we will list the most important ones. For a greater detail, please consult the reference in Streamsets' page ([https://streamsets.com/connectors](https://streamsets.com/connectors)).

These connectors are divided in four types:

- **Origins**: these represent a flow's source and there can be only one per pipeline (link: [https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Origins_overview.html](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Origins_overview.html))
- **Processors: **allow you to process the data in a flow (link: [https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Processors_title.html](https://streamsets.com/documentation/datacollector/3.8.0/help/datacollector/UserGuide/Processors/Processors_title.html))
- **Destinations**: they represent a pipeline's output. There can be one or more destinations(link: [https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Destinations_overview.html](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Destinations_overview.html))
- **Executors**: it triggers a task when it receives an event (link: [https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/Executors-overview.html](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/Executors-overview.html))


The platform includes four components:

- **onesait Platform Origin**: allows to connect to the platform as an origin ([(Dataflow) How to use Onesait origin stage)](https://onesaitplatform.atlassian.net/wiki/spaces/DOCT/pages/2220822212))
- **onesait Platform Lookup**: allows to merge data from queries in the platform, with a different origin ([How to use Onesait lookup processor](https://onesaitplatform.atlassian.net/wiki/spaces/DOCT/pages/2220822386))
- **2 onesait Platform Destination**: allows to dump data in the platform with an INSERT or an UPDATE ([How to use Onesait insert destination](https://onesaitplatform.atlassian.net/wiki/spaces/DOCT/pages/2220822078) & [How to use Onesait update destination](https://onesaitplatform.atlassian.net/wiki/spaces/DOCT/pages/2220822966))

Beyond those, the following components also exist

| **ORIGINS** | **PROCESSORS** | **DESTINATIONS** | **EXECUTORS** |
| --- | --- | --- | --- |
| ## Standalone Pipelines<br>- [Amazon S3](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/AmazonS3.html#concept_kvs_3hh_ht) - Reads objects from Amazon S3. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [Amazon SQS Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/AmazonSQS.html#concept_xsh_knm_5bb) - Reads data from queues in Amazon Simple Queue Services (SQS). Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [Azure IoT/Event Hub Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/AzureEventHub.html#concept_c1z_15q_1bb) - Reads data from Microsoft Azure Event Hub. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [CoAP Server](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/CoAPServer.html#concept_wfy_ghn_sz) - Listens on a CoAP endpoint and processes the contents of all authorized CoAP requests. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [Directory](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Directory.html#concept_qcq_54n_jq) - Reads fully-written files from a directory. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [Elasticsearch](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Elasticsearch.html#concept_f1q_vpm_2z) - Reads data from an Elasticsearch cluster. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [File Tail](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/FileTail.html#concept_n1y_qyp_5q) - Reads lines of data from an active file after reading related archived files in the directory.
- [Google BigQuery](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/BigQuery.html#concept_cg3_y3v_q1b) - Executes a query job and reads the result from Google BigQuery.
- [Google Cloud Storage](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/GCS.html#concept_iyd_wql_nbb) - Reads fully written objects from Google Cloud Storage.
- [Google Pub/Sub Subscriber](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/PubSub.html#concept_pjw_qtl_r1b) - Consumes messages from a Google Pub/Sub subscription. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [Hadoop FS Standalone](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/HDFSStandalone.html#concept_djz_pdm_hdb) - Reads fully-written files from HDFS, Azure Data Lake Storage, or Azure HDInsight. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [HTTP Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/HTTPClient.html#concept_wk4_bjz_5r) - Reads data from a streaming HTTP resource URL.
- [HTTP Server](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/HTTPServer.html#concept_s2p_5hb_4y) - Listens on an HTTP endpoint and processes the contents of all authorized HTTP POST and PUT requests. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [HTTP to Kafka (Deprecated)](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/HTTPtoKafka.html#concept_izh_mqd_dy) - Listens on a HTTP endpoint and writes the contents of all authorized HTTP POST requests directly to Kafka.
- [JDBC Multitable Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MultiTableJDBCConsumer.html#concept_zp3_wnw_4y) - Reads database data from multiple tables through a JDBC connection. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [JDBC Query Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/JDBCConsumer.html#concept_qhf_hjr_bs) - Reads database data using a user-defined SQL query through a JDBC connection.
- [JMS Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/JMS.html#concept_rhh_4nj_dt) - Reads messages from JMS.
- [Kafka Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/KConsumer.html#concept_msz_wnr_5q) - Reads messages from a single Kafka topic.
- [Kafka Multitopic Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/KafkaMultiConsumer.html#concept_ccs_fn4_x1b) - Reads messages from multiple Kafka topics. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [Kinesis Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/KinConsumer.html#concept_anh_4y3_yr) - Reads data from Kinesis Streams. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [MapR DB CDC](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MapRdbCDC.html#concept_qwj_5vm_pbb) - Reads changed MapR DB data that has been written to MapR Streams. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [MapR DB JSON](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MapRDBJSON.html#concept_ywh_k15_3y) - Reads JSON documents from MapR DB JSON tables.
- [MapR FS](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MapRFS.html#concept_psz_db4_lx) - Reads files from MapR FS.
- [MapR FS Standalone](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MapRFSStandalone.html#concept_b43_3qc_mdb) - Reads fully-written files from MapR FS. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [MapR Multitopic Streams Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MapRStreamsMultiConsumer.html#concept_hvd_hww_lbb) - Reads messages from multiple MapR Streams topics. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [MapR Streams Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MapRStreamsCons.html#concept_cvy_xsf_2v) - Reads messages from MapR Streams.
- [MongoDB](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MongoDB.html#concept_bk4_2rs_ns) - Reads documents from MongoDB.
- [MongoDB Oplog](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MongoDBOplog.html#concept_mjn_yqw_4y) - Reads entries from a MongoDB Oplog.
- [MQTT Subscriber](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MQTTSubscriber.html#concept_ukz_3vt_lz) - Subscribes to a topic on an MQTT broker to read messages from the broker.
- [MySQL Binary Log](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MySQLBinaryLog.html#concept_kqg_1yh_xx) - Reads MySQL binary logs to generate change data capture records.
- [Omniture](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Omniture.html#concept_dsr_xmw_1s) - Reads web usage reports from the Omniture reporting API.
- [OPC UA Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/OPCUAClient.html#concept_nmf_1ly_f1b) - Reads data from a OPC UA server.
- [Oracle CDC Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/OracleCDC.html#concept_rs5_hjj_tw) - Reads LogMiner redo logs to generate change data capture records.
- [PostgreSQL CDC Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/PostgreSQL.html#concept_cfs_4m4_n2b) - Reads PostgreSQL WAL data to generate change data capture records.
- [Pulsar Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/PulsarConsumer.html#concept_o2b_1pc_r2b) - Reads messages from Apache Pulsar topics.
- [RabbitMQ Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/RabbitMQ.html#concept_dyg_lq1_h5) - Reads messages from RabbitMQ.
- [Redis Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Redis.html#concept_plr_t3v_jw) - Reads messages from Redis.
- [REST Service](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/RESTService.html#concept_hfg_2sn_p2b) - Listens on an HTTP endpoint, parses the contents of all authorized requests, and sends responses back to the originating REST API.Creates multiple threads to enable parallel processing in a multithreaded pipeline. Use only in microservice pipelines.
- [Salesforce](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Salesforce.html#concept_odf_vr3_rx) - Reads data from Salesforce.
- [SDC RPC](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/SDC_RPCorigin.html#concept_agb_5c1_ct) - Reads data from an SDC RPC destination in an SDC RPC pipeline.
- [SDC RPC to Kafka (Deprecated)](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/SDCRPCtoKafka.html#concept_tdk_slk_pw) - Reads data from an SDC RPC destination in an SDC RPC pipeline and writes it to Kafka.
- [SFTP/FTP Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/SDCRPCtoKafka.html#concept_tdk_slk_pw) - Reads files from an SFTP or FTP server.
- [SQL Server CDC Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/SQLServerCDC.html#concept_ut3_ywc_v1b) - Reads data from Microsoft SQL Server CDC tables. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [SQL Server Change Tracking](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/SQLServerChange.html#concept_ewq_b2s_r1b) - Reads data from Microsoft SQL Server change tracking tables and generates the latest version of each record. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [TCP Server](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/TCPServer.html#concept_ppm_xb1_4z) - Listens at the specified ports and processes incoming data over TCP/IP connections. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [Teradata Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Teradata.html#concept_zp3_wnw_4y) - Reads data from Teradata Database tables through a JDBC connection. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [UDP Multithreaded Source](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/UDPMulti.html#concept_wng_g5f_5bb) - Reads messages from one or more UDP ports. Creates multiple threads to enable parallel processing in a multithreaded pipeline.
- [UDP Source](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/UDP.html#concept_rst_2y5_1s) - Reads messages from one or more UDP ports.
- [UDP to Kafka (Deprecated)](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/UDPtoKafka.html#concept_jzq_jcz_pw) - Reads messages from one or more UDP ports and writes the data to Kafka.
- [WebSocket Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/WebSocketClient.html#concept_unk_nzk_fbb) - Reads data from a WebSocket server endpoint. Can send responses back to the origin system as part of a microservice pipeline.
- [WebSocket Server](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/WebSocketServer.html#concept_u2r_gpc_3z) - Listens on a WebSocket endpoint and processes the contents of all authorized WebSocket client requests. Creates multiple threads to enable parallel processing in a multithreaded pipeline. Can send responses back to the origin system as part of a microservice pipeline.<br>In cluster pipelines, you can use the following origins:<br>- [Hadoop FS](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/HadoopFS-origin.html#concept_lw2_tnm_vs) - Reads data from HDFS, Amazon S3, or other file systems using the Hadoop FileSystem interface.
- [Kafka Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/KConsumer.html#concept_msz_wnr_5q) - Reads messages from Kafka. Use the cluster version of the origin.
- [MapR FS](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MapRFS.html#concept_psz_db4_lx) - Reads data from MapR FS.
- [MapR Streams Consumer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MapRStreamsCons.html#concept_cvy_xsf_2v) - Reads messages from MapR Streams.<br>## Edge Pipelines<br>In edge pipelines, you can use the following origins:<br>- [Directory](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/Directory.html#concept_qcq_54n_jq) - Reads fully-written files from a directory.
- [File Tail](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/FileTail.html#concept_n1y_qyp_5q) - Reads lines of data from an active file after reading related archived files in the directory.
- [gRPC Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/gRPCClient.html#concept_yp1_4zs_yfb) - Reads data from a gRPC server.
- [HTTP Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/HTTPClient.html#concept_wk4_bjz_5r) - Reads data from a streaming HTTP resource URL.
- [HTTP Server](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/HTTPServer.html#concept_s2p_5hb_4y) - Listens on an HTTP endpoint and processes the contents of all authorized HTTP POST and PUT requests.
- [MQTT Subscriber](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/MQTTSubscriber.html#concept_ukz_3vt_lz) - Subscribes to a topic on an MQTT broker to read messages from the broker.
- [System Metrics](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/SystemMetrics.html#concept_gzy_gmv_32b) - Reads system metrics from the edge device where SDC Edge is installed.
- [WebSocket Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/WebSocketClient.html#concept_unk_nzk_fbb) - Reads data from a WebSocket server endpoint.
- [Windows Event Log](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Origins/WindowsLog.html#concept_agf_5jv_sbb) - Reads data from a Microsoft Windows event log located on a Windows machine.<br>## Development Origins<br>To help create or test pipelines, you can use the following development origins:<br>- Dev Data Generator
- Dev Random Source
- Dev Raw Data Source
- Dev SDC RPC with Buffering
- Dev Snapshot Replaying
- Sensor Reader | - [Base64 Field Decoder](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Base64Decoder.html#concept_ujj_spy_kv)
- [Base64 Field Encoder](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Base64Encoder.html#concept_wtr_mpy_kv)
- [Data Generator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/DataGenerator.html#concept_hw1_gq4_3fb)
- [Data Parser](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/DataParser.html#concept_xw3_4xk_r1b)
- [Databricks ML Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/DatabricksML.html#concept_nlz_k3v_gfb)
- [Delay](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Delay.html#concept_ez5_pvf_wbb)
- [Encrypt and Decrypt Fields](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/EncryptDecrypt.html#concept_zs3_vfk_hfb)
- [Expression Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Expression.html#concept_zm2_pp3_wq)
- [Field Flattener](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldFlattener.html#concept_njn_3kk_fx)
- [Field Hasher](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldHasher.html#concept_ivv_c3k_wq)
- [Field Mapper](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldMapper.html#concept_q5y_tdq_xgb)
- [Field Masker](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldMasker.html#concept_hjc_t4k_wq)
- [Field Merger](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldMerger.html#concept_pgm_tsl_gt)
- [Field Order](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldOrder.html#concept_krp_5fv_vy)
- [Field Pivoter](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/ListPivoter.html#concept_ekg_313_qw)
- [Field Remover](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldRemover.html#concept_jdd_blr_wq)
- [Field Renamer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldRenamer.html#concept_vyv_zsg_ht)
- [Field Replacer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldReplacer.html#concept_rw4_2d3_4cb)
- [Field Splitter](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldSplitter.html#concept_vlj_vph_yq)
- [Field Type Converter](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldTypeConverter.html#concept_is3_zkp_wq)
- [Field Zip](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/FieldZip.html#concept_o3b_t1k_yx)
- [Geo IP](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/GeoIP.html#concept_fch_fc3_ms)
- [Groovy Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Groovy.html#concept_ldh_sct_gv)
- [HBase Lookup](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/HBaseLookup.html#concept_mnj_zhq_bw)
- [Hive Metadata](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/HiveMetadata.html#concept_rz5_nft_zv)
- [HTTP Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/HTTPClient.html#concept_ghx_ypr_fw)
- [HTTP Router](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/HTTPRouter.html#concept_ghx_ypr_fw)
- [JavaScript Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/JavaScript.html#concept_n2p_jgf_lr)
- [JDBC Lookup](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/JDBCLookup.html#concept_ysc_ccy_hw)
- [JDBC Tee](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/JDBCTee.html#concept_qbx_lcy_hw)
- [JSON Generator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/JSONGenerator.html#concept_jmg_hw1_h1b)
- [JSON Parser](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/JSONParser.html#concept_bs1_4t3_yq)
- [Jython Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Jython.html#concept_a1h_lkf_lr)
- [Kudu Lookup](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/KuduLookup.html#concept_a1x_3wl_p1b)
- [Log Parser](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/LogParser.html#concept_ulm_qdq_fs)
- [MLeap Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/MLeap.html#concept_wnr_wlv_gfb)
- [MongoDB Lookup](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/MongoDBLookup.html#concept_rrp_t4w_2fb)
- [PMML Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/PMML.html#concept_r3s_3fv_gfb)
- [PostgreSQL Metadata](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/PostgreSQLMetadata.html#concept_lcp_ssh_qcb)
- [Record Deduplicator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/RDeduplicator.html#concept_z3m_v52_zq)
- [Redis Lookup](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/RedisLookup.html#concept_ng3_lpr_pv)
- [Salesforce Lookup](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/SalesforceLookup.html#concept_k23_3rk_yx)
- [Schema Generator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/SchemaGenerator.html#concept_rfz_ks3_x1b)
- [Spark Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Spark.html#concept_cpx_1lm_zx)
- [SQL Parser](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/SQLParser.html#concept_zh2_kfj_tdb)
- [Static Lookup](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/StaticLookup.html#concept_aqz_t4r_pv)
- [Stream Selector](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/StreamSelector.html#concept_tqv_t5r_wq)
- [TensorFlow Evaluator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/TensorFlow.html#concept_otg_csh_z2b)
- [Value Replacer (Deprecated)](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/ValueReplacer.html#concept_o5k_dmf_zq)
- [Whole File Transformer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/WholeFileTransformer.html#concept_nwg_rx4_l2b)
- [Windowing Aggregator](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/Aggregator.html#concept_ofb_svm_5bb)
- [XML Flattener](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/XMLFlattener.html#concept_ck4_255_sv)
- [XML Parser](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Processors/XMLParser.html#concept_dtt_q5q_k5) | ## Standalone Pipelines Only<br>In standalone pipelines, you can use the following destination:<br>- [Rabbit MQ Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MongoDB.html#concept_eth_k5n_4v) - Writes data to RabbitMQ.
- Send Response to Origin - Sends records with the specified response to the microservice origin in the pipeline. Use only in a [microservice pipeline](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Microservice/Microservice_Title.html#concept_qfh_xdm_p2b).<br>## Standalone or Cluster Pipelines<br>In standalone or cluster pipelines, you can use the following destinations:<br>- [Aerospike](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Aerospike.html#concept_gyq_rpr_4cb) - Writes data to Aerospike.
- [Amazon S3](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/AmazonS3.html#concept_avx_bnq_rt) - Writes data to Amazon S3.
- [Azure Data Lake Storage](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/DataLakeStore.html#concept_jzm_kf4_zx) - Writes data to the Azure Data Lake Storage.
- [Azure Event Hub Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/AzureEventHubProducer.html#concept_xq5_d5q_1bb) - Writes data to Azure Event Hub.
- [Azure IoT Hub Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/AzureIoTHub.html#concept_pnd_jkq_1bb) - Writes data to Microsoft Azure IoT Hub.
- [Cassandra](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Cassandra.html#concept_hfy_mfd_sr) - Writes data to a Cassandra cluster.
- [CoAP Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/CoAPClient.html#concept_hw5_s3n_sz) - Writes data to a CoAP endpoint.
- [Couchbase](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Couchbase.html#concept_ahq_1wq_h2b) - Writes data to a Couchbase database.
- [Elasticsearch](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Elasticsearch.html#concept_u5t_vpv_4r) - Writes data to an Elasticsearch cluster.
- [Einstein Analytics](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/WaveAnalytics.html#concept_hlx_r53_rx) - Writes data to Salesforce Einstein Analytics.
- [Flume](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Flume.html#concept_pzn_hl4_yr) - Writes data to a Flume source.
- [Google BigQuery](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/BigQuery.html#concept_hj4_brk_dbb) - Streams data into Google BigQuery.
- [Google Bigtable](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Bigtable.html#concept_pl5_tmq_tx) - Writes data to Google Cloud Bigtable.
- [Google Cloud Storage](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/GCS.html#concept_p4n_jrl_nbb) - Writes data to Google Cloud Storage.
- [Google Pub/Sub Publisher](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/PubSubPublisher.html#concept_qsj_hk1_v1b) - Publishes messages to Google Pub/Sub.
- [Hadoop FS](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/HadoopFS-destination.html#concept_awl_4km_zq) - Writes data to HDFS, Azure Data Lake Storage, or Azure HDInsight.
- [HBase](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/HBase.html#concept_wsz_5t5_vr) - Writes data to an HBase cluster.
- [Hive Metastore](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/HiveMetastore.html#concept_gcr_z2t_zv) - Creates and updates Hive tables as needed.
- [Hive Streaming](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Hive.html#concept_kvs_3hh_ht) - Writes data to Hive.
- [HTTP Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/HTTPClient.html#concept_khl_sg5_lz) - Writes data to an HTTP endpoint. Can send responses to a microservice origin in a microservice pipeline.
- [InfluxDB](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/InfluxDB.html#concept_inf_db_sr) - Writes data to InfluxDB.
- [JDBC Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/JDBCProducer.html#concept_kvs_3hh_ht) - Writes data to JDBC.
- [JMS Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/JMSProducer.html#concept_sfz_ww5_n1b) - Writes data to JMS.
- [Kafka Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/KProducer.html#concept_oq2_5jl_zq) - Writes data to a Kafka cluster. Can send responses to a microservice origin in a microservice pipeline.
- [Kinesis Firehose](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/KinFirehose.html#concept_bjv_dpk_kv) - Writes data to a Kinesis Firehose delivery stream.
- [Kinesis Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/KinProducer.html#concept_swk_h1j_yr) - Writes data to Kinesis Streams. Can send responses to a microservice origin in a microservice pipeline.
- [KineticaDB](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/KineticaDB.html#concept_hxh_5xg_qbb) - Writes data to a table in a Kinetica cluster.
- [Kudu](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Kudu.html#concept_chy_xxg_4v) - Writes data to Kudu.
- [Local FS](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/LocalFS.html#concept_zvc_bv5_1r) - Writes data to a local file system.
- [MapR DB](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MapRDB.html#concept_vxg_w2z_yv) - Writes data as text, binary data, or JSON strings to MapR DB binary tables.
- [MapR DB JSON](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MapRDBJSON.html#concept_i4h_2kj_dy) - Writes data as JSON documents to MapR DB JSON tables.
- [MapR FS](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MapRFS.html#concept_spv_xlc_fv) - Writes data to MapR FS.
- [MapR Streams Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MapRStreamsProd.html#concept_cfj_qbn_2v) - Writes data to MapR Streams.
- [MemSQL Fast Loader](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MemSQLLoader.html#concept_kvs_3hh_ht) - Writes data to MemSQL or MySQL.
- [MongoDB](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MongoDB.html#concept_eth_k5n_4v) - Writes data to MongoDB.
- [MQTT Publisher](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MQTTPublisher.html#concept_odz_txt_lz) - Publishes messages to a topic on an MQTT broker.
- [Named Pipe](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/NamedPipe.html#concept_pl5_tdg_gcb) - Writes data to a named pipe.
- [Pulsar Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/PulsarProducer.html#concept_fq3_kpc_r2b) - Writes data to Apache Pulsar topics.
- [Redis](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Redis.html#concept_ktc_gw2_gw) - Writes data to Redis.
- [Salesforce](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Salesforce.html#concept_rlb_rt3_rx) - Writes data to Salesforce.
- [SDC RPC](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/SDC_RPCdest.html#concept_lfk_hx2_ct) - Passes data to an SDC RPC origin in an SDC RPC pipeline.
- [Snowflake](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Snowflake.html#concept_vxl_zzc_1gb) - Writes data to tables in a Snowflake database.
- [Solr](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Solr.html#concept_z2g_q1r_wr) - Writes data to a Solr node or cluster.
- [Splunk](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Splunk.html#concept_zzr_pqn_xdb) - Writes data to Splunk.
- [Syslog](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Syslog.html#concept_idr_ct5_w2b) - Writes data to a Syslog server.
- [To Error](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/ToError.html#concept_ryn_v3z_lr) - Passes records to the pipeline for error handling.
- [Trash](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/Trash.html#concept_htf_ydj_wq) - Removes records from the pipeline.
- [WebSocket Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/WebSocketClient.html#concept_l4d_mjn_lz) - Writes data to a WebSocket endpoint.<br>## Edge Pipelines<br>In edge pipelines, you can use the following destinations:<br>- [CoAP Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/CoAPClient.html#concept_hw5_s3n_sz) - Writes data to a CoAP endpoint.
- [HTTP Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/HTTPClient.html#concept_khl_sg5_lz) - Writes data to an HTTP endpoint.
- [Kafka Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/KProducer.html#concept_oq2_5jl_zq) - Writes data to a Kafka cluster.
- [Kinesis Firehose](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/KinFirehose.html#concept_bjv_dpk_kv) - Writes data to a Kinesis Firehose delivery stream.
- [Kinesis Producer](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/KinProducer.html#concept_swk_h1j_yr) - Writes data to Kinesis Streams.
- [MQTT Publisher](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/MQTTPublisher.html#concept_odz_txt_lz) - Publishes messages to a topic on an MQTT broker.
- [To Error](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/ToError.html#concept_ryn_v3z_lr) - Passes records to the pipeline for error handling.
- [WebSocket Client](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Destinations/WebSocketClient.html#concept_l4d_mjn_lz) - Writes data to a WebSocket endpoint.<br>## Development Destination<br>To help create or test pipelines, you can use the following development destination:<br>- To Event | - [Amazon S3](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/AmazonS3.html#concept_mvh_bnm_f1b) - Creates new Amazon S3 objects for the specified content, copies objects within a bucket, or adds tags to existing Amazon S3 objects.
- [Databricks](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/Databricks.html#concept_fdc_qrx_jz) - Starts the specified Databricks job upon receiving an event record.
- [Email](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/Email.html#concept_sjs_sfp_qz) - Sends custom email to the configured recipients upon receiving an event.
- [HDFS File Metadata](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/HDFSMetadata.html#concept_wgj_slk_fx) - Changes file metadata, creates an empty file, or removes a file or directory in HDFS or a local file system upon receiving an event record.
- [Hive Query](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/HiveQuery.html#concept_kjw_llk_fx) - Runs user-defined Hive or Impala queries upon receiving an event record.
- [JDBC Query](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/JDBCQuery.html#concept_j3r_gcv_sx) - Runs a user-defined SQL query upon receiving an event record.
- [MapR FS File Metadata](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/MapRFSFileMeta.html#concept_ohx_r5h_z1b) - Changes file metadata, creates an empty file, or removes a file or directory in MapR FS upon receiving an event record.
- [MapReduce](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/MapReduce.html#concept_bj2_zlk_fx) - Starts the specified MapReduce job upon receiving an event record.
- [Pipeline Finisher](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/PipelineFinisher.html#concept_qzm_l4r_kz) - Stops and transitions the pipeline to a Finished state upon receiving an event record.
- [Shell](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/Shell.html#concept_jsr_zpw_tz) - Executes a shell script upon receiving an event record.
- [Spark](https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Executors/Spark.html#concept_cvy_vxb_1z) - Starts the specified Spark application upon receiving an event record. |