2

I am new in Apache Drill. I have gone through the Apache Drill official site and their documentation, but couldn't understand when to use Distribute system and when to use Embedded System.

I want to apply Drill in live project.So please give some advice which one to use (Embedded or Distributed) and how ?

Thanks in advance.

Sanjiv
  • 440
  • 1
  • 7
  • 26

1 Answers1

2

Embedded Mode: This requires less configuration & it is preferred for testing purpose.

As per drill docs:

Drill in embedded mode installs Drill locally on your machine. Embedded mode is a quick way to install and try Drill without having to perform any configuration tasks. A ZooKeeper installation is not required. Installing Drill in embedded mode configures the local Drillbit service to start automatically when you launch the Drill shell.

Distributed Mode: In this mode, drill runs on one or more nodes in a clustered environment. Running a ZooKeeper quorum is required.

As you asked, for live project you should use distributed mode. If you are using any hadoop cluster, you can install Drill on the same cluster. You need to install Drill on all the nodes. Check docs for more details.

Edit:

As you are new to Drill, for POC purpose you should use embedded mode.

  • Download Drill.

  • Start Drill with command bin/drill-embedded (for linux). For windows check docs.

  • Add plugin through web UI

  • Start Querying.
Dev
  • 11,996
  • 15
  • 57
  • 138
  • please give some explanation dev..? – Sanjiv Mar 11 '16 at 14:28
  • Please go through documentation of apache drill (_I shared useful links in answer_) if you find any issue while installing or running stackoverflow is happy to help...:) – Dev Mar 12 '16 at 05:36
  • It would be better if you share your use case in brief in the question – Dev Mar 12 '16 at 05:37
  • I want to get data from different data sources(oracle, sql, mysql, etc) throught c# Programming. please suggest me which one to use(distributed or embedded)..?? – Sanjiv Mar 14 '16 at 05:58
  • would you please tell me about REST API. How can i used in Window. The doc which drill provide don't have any info about REST API for window. They give info about linux only. Would you please tell me how can i used REST API for programatically creating new storage plugin in window. – Sanjiv Mar 14 '16 at 09:52
  • as I told you on your other answer. check this: http://stackoverflow.com/questions/35308055/how-to-create-connection-in-storage-plugin-of-apache-drill-programmitically-in-c **READ COMMENTS TOO.** – Dev Mar 14 '16 at 17:04
  • I will tell you my live scenario:- I have a web project, I want to use Apache Drill to fetch data from different Data Sources(DBs). For that I am using Web Application. My Question is. How Can I Used Drill in My Project. And If Some User Creating New Connection then New Storage Plugin Should be Created In Drill for That Connection through Code. – Sanjiv Mar 15 '16 at 06:32
  • @SanjivKumar I guess you are able to achieve adding plugin via code. I saw your answer: http://stackoverflow.com/a/36008584/3929393 So your problem solved – Dev Mar 16 '16 at 07:18
  • Ya dev I am able to achieve. But I want to know how to configure PAM authentication in window for drill – Sanjiv Mar 16 '16 at 07:21
  • How to start drill in distributed mode in window – Sanjiv Mar 16 '16 at 10:19
  • Go to the node on which drill is installed. Use `bin/drillbit.sh start` – Dev Mar 16 '16 at 11:29
  • I have very important doubt : whether Apache Drill only supports [dbo] schema?? or it will support all type of schema. BECAUSE, I am trying to search with same storage plugin.. it work for [dbo] schema while other schema such as [core] its not working :: EXAMPLE:-- select * from SqlServer.dbo.Attribute;(Its Working). BUT select * from SqlServer.core.Users(its not working).?? – Sanjiv Mar 16 '16 at 11:32
  • :-- Do have any idea about this schema problem dev. I am running this query for SQL SERVER. – Sanjiv Mar 16 '16 at 13:14
  • @SanjivKumar Do your user has permission to read data from core schema? It should work for all schemas – Dev Mar 16 '16 at 13:35
  • Ya it has permisssion – Sanjiv Mar 16 '16 at 14:15
  • :-Is there any in drill to provide permission for schema..? Because all my schema has same type. There is no different b/w dbo and core schema. dbo is working but core is not working.. It showing table is not present. – Sanjiv Mar 16 '16 at 14:19
  • @SanjivKumar I would say ask a different questions with plugin details, drill version, mode, OS details, etc. so that it will help the community. – Dev Mar 17 '16 at 04:48