Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

6.  def discrepancyStats(compositeKeyStrs: Seq[String]): DataFrame

   This method compares all "l_" with their corresponding "r_" columns from the joined table returned in fullOuterJoinDataFrames() and returns a DataFrame that maps column names with the amount of discrepant entries between those l_ and r_ columns.

   This method compares all "l_" with their corresponding "r_" columns from the joined table returned in fullOuterJoinDataFrames() and returns a DataFrame that maps column names with the amount of discrepant entries between those l_ and r_ columns.

   compositeKeyStrs

   a Sequence of Strings having the primary keys applicable for both DataFrames

   returns

   a DataFrame that maps between column names and the amount of discrepant entries for those "l_/r_" rows in the full outer joined table.

7.  final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

8.  def finalize(): Unit

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( classOf[java.lang.Throwable] )

9.  def fullOuterJoinDataFrames(compositeKeyStrs: Seq[String]): DataFrame

   This method does a full outer join between the resulting left and right DataFrames from the method SparkCompare.compareSchemaDataFrames.

   This method does a full outer join between the resulting left and right DataFrames from the method SparkCompare.compareSchemaDataFrames. It will return a single DataFrame having the left columns prefixed with l_ and the right columns prefixed with r_. the Key columns will not have prefixed. The resulting DataFrame will have all l_ columns on the left, then the Key columns in the middle, then the r_ columns on the right.

   compositeKeyStrs

   a Sequence of Strings having the primary keys applicable for both DataFrames

   returns

   a DataFrame having the resulting full outer join operation.

10.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

11.  def getInLeftNotInRight(): DataFrame
12.  def getInRightNotInLeft(): DataFrame
13.  def getOrderedResult(orderByCols: Array[String], isAsc: Boolean): DiffResult

    Order the result by the provided columns.

    Order the result by the provided columns.

    orderByCols

    is the column provided for order

    isAsc

    is the indicator for ascending or descending order.

    returns

    the ordered data set

14.  val inLeftNotInRight: DataFrame
15.  val inRightNotInLeft: DataFrame
16.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

17.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

18.  def noDiff(): Boolean

    Indicating whether there is difference in the comparison.

    Indicating whether there is difference in the comparison.

    returns

    true if there is no difference; false if there is difference.

19.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

20.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

21.  def removeCols(excludeCols: Array[String]): DiffResult

    Exclude some columns from the data set so that it won't be saved.

    Exclude some columns from the data set so that it won't be saved.

    excludeCols

    the column array that contains the columns to exclude from the data set

    returns

    the data set without the columns

22.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

23.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

24.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

25.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()