jacklin2015
- 浏览: 124397 次
- 性别:
- 来自: 深圳
-
最新评论
-
jacklin2015：
...
scrapy 抓的段子里的 \n 去不掉 -
jacklin2015：
''.join(sel.css("div.item- ...
scrapy 抓的段子里的 \n 去不掉 -
jacklin2015：
...
linux fdisk mount -
jacklin2015：
...
python mongodb 正则查询
文章列表
#####1.apt-get install zlib1g-dev libncurses5-dev libncurses5-dev bison autoconf wget patch dos2unix libgles2-mesa-dev libgles2-mesa gcc-arm-linux-gnueabi g++-arm-linux-gnueabi u-boot-tools zlib1g.dev texinfo gettext
1.apt-get install -y gawk git gnupg flex bison gperf build-essential zip curl ...
java.lang.NullPointerException: null
at org.apache.cassandra.db.ColumnFamilyStore.removeUnfinishedCompactionLeftovers
提示: /data/******/la-** 不存在
原因：
用 find ./ -name "la-*" -mtime +n -print -delete
可能是同一个sstable 的几个文件时间有差错，只删了一部分文件，没有删完，把提示的那个文件的其他文件找出来：
ll -h /data/*****/la-395693-big-*
...
import org.apache.spark.sql.SQLContext
import org.apache.spark.{SparkConf, SparkContext}
import org.apache.spark.sql.types._
import spark.implicits._
import org.apache.spark.sql.functions.udf
import org.apache.spark.sql._
object Run {
def main(args: Array[String]) {
val conf = new SparkConf ...
问题1：
root 用户运行pyspark 没问题
hadoop 用户运行就报如下错
df1 = spark.read.format("com.mongodb.spark.sql.DefaultSource").option("collection","devices").load()
17/02/15 19:34:26 WARN MongoInferSchema: Field 'devcaps' contains conflicting types converting to StringType
17/02/15 19:34:27 ...
运行zeppelin 0.6.×时遇到问题：（0.7.*不需要下面的步骤的）
1. java.lang.NoSuchMethodError: org.apache.hadoop.tracing.SpanReceiverHost.get(Lorg/apache/hadoop/conf/
solution：
cd zeppelin-0.6.2-bin-all/lib
rm hadoop-annotations-×××.jar
rm hadoop-auth-×××.jar
rm hadoop-common-×××.jar
cp spark/jars/hadoop-annotations-×××.j ...
产生证书文件：
openssl genrsa -des3 -out jack.key 2048
openssl req -new -key jack.key -out jack.csr
openssl req -new -x509 -days 3650 -key jack.key -out jack.crt
#passwd: passphrase
启动nginx 免密码，要重新 生成key文件
openssl rsa -in jack.key -out jack.key.passfree
nginx 配置：
server{
listen 443 ssl;
...
URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:581)>
用python2.7.9 向https：//××××××× post 数据时 报错。
原因：
网站用了自己的证书而非官方授权的证书
解决方法：#不用验证 证书
import ssl
ssl._create_default_https_context = ssl._create_unverified_context
yum install epel-release
python post，get 的 方法
post #参数有 data 就是 post，没有data 是 get
1
url="https://api.ext.m-m10010.com/open/unicom/BatchQueryTerminal"
data = {"userId":MLB_USERID,"num":imsis,"num_type":"imsi","timestamp":dt,"sign":token}
req = urllib2.Req ...
SVNVERSION=not-found ./configure
不要直接用 ./configure
据说这是bug
饼状图 的labels 的中文 显示成方框了，plot.title() 也显示不了中文。
$ fc-list :lang=zh #查看可用的中文字体
/usr/share/fonts/truetype/arphic/uming.ttc: AR PL UMing TW MBE:style=Light
/usr/share/fonts/X11/misc/18x18ja.pcf.gz: Fixed:style=ja
/usr/share/fonts/truetype/arphic/ukai.ttc: AR PL UKai CN:style=Book
/usr/share/fonts/truetyp ...
首先在ubuntu上完成下列步骤
1. sudo apt-get install xrdp
2. sudo apt-get install vnc4server
3. sudo apt-get install xubuntu-desktop
4. echo "xfce4-session" >~/.xsession
5. sudo service xrdp restart
然后在windows7 上
"窗口键+R"打开"运行对话框"-->输入"mstsc"-->回车-->输入Ubuntu主机 ...
imeadmin@imeadmin:~/work/test$ svn co https://192.168.1.100/svn/mtk6735/trunk
Error validating server certificate for 'https://192.168.1.100:443':
- The certificate is not issued by a trusted authority. Use the
fingerprint to validate the certificate manually!
- The certificate hostname does no ...
# mount /dev/sdd1 /mnt
mount: /dev/sdd1 already mounted or /mnt busy
# mkfs.ext4 /dev/sdd1
/dev/sdd1 is apparently in use by the system; will not make a filesystem here!
以上两个提示的解决方法
# dmsetup status
35000c50070b2d48f-part1: 0 1172118402 linear
35000c50070b2d48f: 0 1172123568 multipath 2 0 0 0 1 ...
File "/usr/lib64/python2.6/site-packages/Crypto/Util/number.py", line 56, in <module>
if _fastmath is not None and not _fastmath.HAVE_DECL_MPZ_POWM_SEC:
AttributeError: 'module' object has no attribute 'HAVE_DECL_MPZ_POWM_SEC'
solution：
pip install PyCrypto==2.3