• spark-sql jdbc操作mysql


      SparkConf sparkConf = new SparkConf()
                    .setMaster("local")
                    .setAppName("MySqlTest");
    
            JavaSparkContext javaSparkContext = new JavaSparkContext(sparkConf);
    
            SQLContext sqlContext = new SQLContext(javaSparkContext);
    
            Properties properties = new Properties();
            properties.setProperty("driver", "com.mysql.jdbc.Driver");
            properties.setProperty("user", "root");
            properties.setProperty("password", "123456");
    
    
            DataFrame df_jdbc = sqlContext.read().jdbc("jdbc:mysql://127.0.0.1:3306/bi?characterEncoding=utf8", "customer", properties);
    
            DataFrame df_jdbc_single_col = df_jdbc.select("cusCode");
            df_jdbc_single_col.show();
    
            //保存=====================
            Map<String, String> map = new HashMap<String, String>();
            map.put("driver", "com.mysql.jdbc.Driver");
            map.put("user", "root");
            map.put("password", "123456");
    
            df_jdbc_single_col.write().options(map).jdbc("jdbc:mysql://127.0.0.1:3306/bi?characterEncoding=utf8", "customer_one_col", properties);
            //=======================
  • 相关阅读:
    python面向对象__call__
    python的上下文管理协议
    python析构方法__del__
    next和iter可迭代协议
    __slots__ 用法
    定制自己的数据类型
    内置的Attr系列
    反射和自省
    isinstance和issubclass
    BLE 学习
  • 原文地址:https://www.cnblogs.com/zzq-include/p/8743476.html
Copyright © 2020-2023  润新知