Step : 1 :Create Project
https://cloud.google.com/
Step : 2 : Create Apache Spark Cluster
Using gcloud command:
gcloud dataproc clusters create smit-recco-cluster
(It will generate error)
Appropriate machine type : https://cloud.google.com/compute/docs/machine-types
Appropriate Region-Zone : https://cloud.google.com/compute/docs/regions-zones/
gcloud dataproc clusters create smit-reco-cluster --worker-machine-type=n1-standard-2
About Hadoop YARN(https://hortonworks.com/blog/introducing-apache-hadoop-yarn/)
Step : 3 (Google mySql)
(HELP regarding MYSQL):- https://cloud.google.com/sql/docs/mysql/quickstart?hl=en#create
- Setup cloud mySQL VM
- Connect using commandline
gcloud sql connect smit-reco-mysql --user=root
-Create Storage Bucket
execute following command in shell-
gsutil cp gs://solutions-public-assets/recommendation-spark/sql/table_creation.sql gs://<your-bucket>/recommendation-spark/sql/table_creation.sql
https://cloud.google.com/
Step : 2 : Create Apache Spark Cluster
Using gcloud command:
gcloud dataproc clusters create smit-recco-cluster
(It will generate error)
Appropriate machine type : https://cloud.google.com/compute/docs/machine-types
Appropriate Region-Zone : https://cloud.google.com/compute/docs/regions-zones/
gcloud dataproc clusters create smit-reco-cluster --worker-machine-type=n1-standard-2
About Hadoop YARN(https://hortonworks.com/blog/introducing-apache-hadoop-yarn/)
Step : 3 (Google mySql)
(HELP regarding MYSQL):- https://cloud.google.com/sql/docs/mysql/quickstart?hl=en#create
- Setup cloud mySQL VM
- Connect using commandline
gcloud sql connect smit-reco-mysql --user=root
-Create Storage Bucket
execute following command in shell-
gsutil cp gs://solutions-public-assets/recommendation-spark/sql/table_creation.sql gs://<your-bucket>/recommendation-spark/sql/table_creation.sql