Per project: select to enable these connection settings only for the current project. Name: the name of the connection to distinguish it between the other connections. Example: hdfs://127.0.0.1:65224/.Ĭonfig path a path to the HDFS configuration files directory.
When the connection is successfully established the Driver home path field shows the target IP address of connection including a port number. Root path: a path to the root directory on the target server. Storages: AWS S3, Minio, Linode, Digital Open Spaces, GS, Azure, Yandex Object Storage, Alibaba OSS In the Big Data Tools Connection dialog, specify the following parameters depending on the server type:įile Systems: File Systems | Local, File Systems | HDFS The Big Data Tools Connection dialog opens. In the Big Data Tools window, click and select the server type. You can connect to HDFS, WebHDFS, AWS S3, and a local drive using config files and URI. Once the Big Data Tools support is enabled in the IDE, you can configure a connection to a Zeppelin,Spark, Google Storage, and S3 server.
Click it to open the Big Data Tools window.
After the restart, the Big Data Tools tab appears in the rightmost group of the tool windows. Python (if you want to use Python in your Zeppelin notebooks) Press Ctrl+Alt+S to open the IDE settings and select Plugins | Marketplace. So, open an existing project ( File | Open) or create a new project ( File | New | Project). Whatever you do in IntelliJ IDEA, you do it in a project.
Data set and hfs file system access ssh install#
Before you start working with Big Data Tools, you need to install the required plugins and configure connections to servers.
0 kommentar(er)
