Sqoop Connectors

Let’s study about Sqoop Connectors,

Objective

Sqoop Connectors designed to support Data transfer between Sqoop and external storage system.

* Sqoop is a connector-based architecture, which plug-in provides connectivity to external systems.

* It uses connectors to connect with external systems (as shown in above diagram), which optimized import and export facilities.

* Connectors are plug-in based components in sqoop. The extension framework in sqoop support to added to any existing Sqoop installation.

* Sqoop connectors support to work with a wide range of popular relational databases like MySQL, PostgreSQL, Oracle, SQL Server, and DB2.

* These connectors easily interact with its associated DBMS. It also contains a generic JDBC connector for connecting to any database that supports Java’s JDBC protocol.

* Sqoop provides optimized MySQL and PostgreSQL connectors that use database-specific APIs to perform bulk transfers efficiently.

The following connectors are availlable for Sqoop,

  1. MySQL connector used to connect to MySQL JDBC Connector.
  2. Netezza connector used to connect Netezza.
  3. Oracle JDBC connector used as Data Connector for Oracle and Hadoop.
  4. PostgreSQL connector used for PostgreSQL.
  5. Microsoft SQL Server connector for Microsoft SQL.
  6. Teradata connector used to connect Teradata.

Conclusion

In this topic we can conclude that main design goal of sqoop connectors is to transfer data between Sqoop and external storage system, It interact with various popular relational databases like MySQL, PostgreSQL, Oracle, SQL Server, and DB2.

That’s all about the Sqoop connectors, will see the magical work of connectors in the sqoop command article.