如何在 jupyter notebook 上集成 pyspark

本文介绍了如何在 jupyter notebook 上集成 pyspark的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！ 问题描述

我已按照说明将 pyspark 与 jupyter 集成，但完成后我只能在命令提示符下运行 pyspark.

i have followed instructions to integrate pyspark with jupyter but after i was done i was only able to run pyspark on the command prompt .

基本上当我在我的命令中使用 ipython 时它正在工作，但是当我更改为 jupyter 时它说

Basically when i am using ipython in my command it is working but when i change to jupyter it says

'"Jupyter "' is not recognized as an internal or external command, operable program or batch file.

拜托各位，我现在真的很累了，请帮忙

please SO people i am really exhausted now , please help

注意:我遵循了本教程做我的整合.

note : i followed this tutorial to do my integration .

直到现在我都遵循了这个命令:

till now i have followed this command :

set PYSPARK_DRIVER_PYTHON=ipython set PYSPARK_DRIVER_PYTHON_OPTS = notebook pyspark

它在 cmd 本身中打开 pyspark

it opens pyspark in cmd itself

推荐答案

Windows set 命令不接受 = 符号前的空格.

Windows set command does not accept spaces before the = sign.

像这样解决这个问题:

set PYSPARK_DRIVER_PYTHON=ipython set PYSPARK_DRIVER_PYTHON_OPTS=notebook pyspark

系统想要运行 "Jupyter %PYSPARK_DRIVER_PYTHON_OPTS%" 可执行文件，但尝试运行 '"Jupyter "'

The system wants to run the "Jupyter %PYSPARK_DRIVER_PYTHON_OPTS%" executable but instead tries to run '"Jupyter "'

因此你得到的错误.