How to eval spark.ml model without DataFrames/SparkContext? -

-

with spark mllib, i'd build model (like randomforest), , possible eval outside of spark loading model , using predict on passing vector of features.

it seems spark ml, predict called transform , acts on dataframe.

is there way build dataframe outside of spark since seems 1 needs sparkcontext build dataframe?

am missing something?

re: is there way build dataframe outside of spark?

it not possible. dataframes live inside sqlcontext living in sparkcontext. perhaps work around somehow, whole story connection between dataframes , sparkcontext design.


Comments

Post a Comment

Popular posts from this blog

Lists in Python -

-
i noticed can multiply list scalar behavior weird if multiply: [2,3,4] * 3 i get: [2,3,4,2,3,4,2,3,4 ] understand results it's for? there other weird operations that? the main purpose of operand initialisation. example, if want initialize list 20 equal numbers can using loop: arr=[] in range(20): arr.append(3) an alternative way using operator: arr = [3] * 20 more weird , normal list operation on lists can find here http://www.discoversdk.com/knowledge-base/using-lists-in-python
Read more

android - can not access to progress bar in an other activity -

-
i have objects in layout video view,text view , on comes this: <?xml version="1.0" encoding="utf-8"?> <android.support.v7.widget.cardview android:id="@+id/cardview_mypost" android:layout_width="match_parent" android:layout_height="wrap_content" android:layout_marginbottom="@dimen/activity_vertical_margin" app:cardcornerradius="@dimen/activity_vertical_margin" app:cardelevation="@dimen/activity_vertical_margin" xmlns:android="http://schemas.android.com/apk/res/android" xmlns:app="http://schemas.android.com/apk/res-auto"> <relativelayout xmlns:android="http://schemas.android.com/apk/res/android" android:layout_width="fill_parent" android:layout_height="wrap_content" android:background="@color/web_withe_color" android:animatelayoutchanges="@anim/anim_list" android:padding="8dp" > <!-- thu...
Read more

java - Vaadin 7 Pass Data Between Views -

-
i have 2 vaadin views , want make search process these 2 views. first view contains textfield search parameter , button seach process. want is, once user click search button, want send search parameter second view , call search method dao classes here display search result. vaadin newbie , dont have idea how appreciated. the classic approach pass data view via parameters of view (this allows bookmark search). see view interface: void enter(viewchangelistener.viewchangeevent event) this view navigated to. method called before view shown on screen. event.getparameters() may contain parameters relevant view. you can send parameters originating view via navigator. e.g. navigator.navigateto("search/searchterm") // `search` view name, `searchterm` passed param see example in handling uri fragment path of book of vaadin
Read more