intro.ipynb
16.9 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# liantongzhidao_filter 说明\n",
"0. **下载地址：** [百度网盘](https://pan.baidu.com/s/1oYi9SfbXpnvreJYGV837Nw)\n",
"1. **数据概览：** 20.3万 条联通问答数据\n",
"2. **推荐实验：** FAQ 问答系统\n",
"3. **数据来源：** 百度知道\n",
"4. **加工处理：**\n",
" 1. 过滤了id、url、qid、reply_t、user字段\n",
" 2. 对question、reply做了脱敏处理"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {},
"outputs": [],
"source": [
"import pandas as pd"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [],
"source": [
"path = 'liantongzhidao_文件夹_所在_路径'"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# 1. liantongzhidao_filter.csv"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## 加载数据"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {},
"outputs": [],
"source": [
"pd_all = pd.read_csv(path + 'liantongzhidao_filter.csv')"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## 字段说明\n",
"\n",
"| 字段 | 说明 |\n",
"| ---- | ---- |\n",
"| title | 问题的标题 |\n",
"| question | 问题内容（可为空） |\n",
"| reply| 回复内容 |\n",
"| is_best| 是否为页面上显示的最佳回答 |"
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"<div>\n",
"<style scoped>\n",
" .dataframe tbody tr th:only-of-type {\n",
" vertical-align: middle;\n",
" }\n",
"\n",
" .dataframe tbody tr th {\n",
" vertical-align: top;\n",
" }\n",
"\n",
" .dataframe thead th {\n",
" text-align: right;\n",
" }\n",
"</style>\n",
"<table border=\"1\" class=\"dataframe\">\n",
" <thead>\n",
" <tr style=\"text-align: right;\">\n",
" <th></th>\n",
" <th>title</th>\n",
" <th>question</th>\n",
" <th>reply</th>\n",
" <th>is_best</th>\n",
" </tr>\n",
" </thead>\n",
" <tbody>\n",
" <tr>\n",
" <th>104525</th>\n",
" <td>拖欠联通话费会有利息出现吗？</td>\n",
" <td>NaN</td>\n",
" <td>应该没有</td>\n",
" <td>0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>116168</th>\n",
" <td>5S日版为什么插移动卡可以用.联通卡就不读卡</td>\n",
" <td>NaN</td>\n",
" <td>苹果手机卡贴分为移动和联通的，说明卡贴支持移动卡，不支持联通卡，主要是网络制式决定的。联通网...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>154475</th>\n",
" <td>联通空中号激活了也不能打电话是怎么回事</td>\n",
" <td>联通空中号激活了也不能打电话是怎么回事</td>\n",
" <td>手机已激活却无法接打电话的常见原因及解决方法如下：【1】检查手机是否欠费停机，建议缴费充值；...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>153069</th>\n",
" <td>联通48元送2g活动本月月租到底算不算进去？</td>\n",
" <td>NaN</td>\n",
" <td>算</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>195043</th>\n",
" <td>VI###13是不是不支持联通上网卡</td>\n",
" <td>NaN</td>\n",
" <td>VI###13支持联通上网卡。网络参考：主屏尺寸：4.5英寸主屏分辨率：854x480像素后...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>5235</th>\n",
" <td>电话号码能定位是真吗</td>\n",
" <td>电话号码能定位是真吗</td>\n",
" <td>当然了</td>\n",
" <td>0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>10472</th>\n",
" <td>索尼LT22i可以刷机到4.1吗</td>\n",
" <td>NaN</td>\n",
" <td>由于手机所支持的网络是由硬件所确定的，无法通过破解软件或者升级软件系统让手机支持其他运营商的...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>86083</th>\n",
" <td>苹果ip##ne手机的个人热点怎么设置使用</td>\n",
" <td>NaN</td>\n",
" <td>1、点击“设置”选项;2、在“设置”界面中找到“个人热点”;3、然后我们可以看到“个人热点”...</td>\n",
" <td>0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>150247</th>\n",
" <td>我用的联通的号码，信号一会有一会没有，请问到底是怎什么回事</td>\n",
" <td>NaN</td>\n",
" <td>信号不好，手机因素，运营商问题，手机卡问题，很多因素你可以到当地联通营业厅寻求帮助</td>\n",
" <td>0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>202724</th>\n",
" <td>流量畅享包订购生效时间</td>\n",
" <td>NaN</td>\n",
" <td>您订购沃商店/沃游戏流量畅享包后，订购当月立即生效，按月自动续订；退订月底生效，当月可继续使...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>44450</th>\n",
" <td>办了腾讯大王卡，激活后，身份证是不是就剩下半俩张卡的机会了</td>\n",
" <td>办了腾讯大王卡，激活后，身份证是不是就剩下半俩张卡的机会了</td>\n",
" <td>每人仅可预约一张音乐小*卡或视频小*卡或腾讯大*卡或腾讯天*卡（一共仅1张）（识别条件为：联...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>65875</th>\n",
" <td>现在有联通的合约机吗</td>\n",
" <td>NaN</td>\n",
" <td>联通有合约机。合约种类大致有存话费送手机、买手机送话费、合约惠机等，具体合约种类可登录联通网...</td>\n",
" <td>0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>51934</th>\n",
" <td>联通卡那个腾讯应用省内定向流量免费是什么意思啊</td>\n",
" <td>NaN</td>\n",
" <td>大王卡，对腾讯的应用，都免流量！</td>\n",
" <td>0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>155866</th>\n",
" <td>怎么设置电信手机彩铃？</td>\n",
" <td>NaN</td>\n",
" <td>设置中*电信的彩铃可以自己在网上操作的，前提是先开通中*电信的彩铃业务，可以直接致电电信客服...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>118696</th>\n",
" <td>联通手机号挂失还能交费吗</td>\n",
" <td>NaN</td>\n",
" <td>1、挂失状态下可以交费。交费渠道与手机正常状态下是一样的。2、温馨提示：如果号码有套餐，挂失...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>115890</th>\n",
" <td>我刚买了一张联通卡，过了几天我怎么收到达飞即有分期让我还款的信息</td>\n",
" <td>我刚买了一张联通卡，过了几天我怎么收到达飞即有分期让我还款的信息，我又没有借过，该怎么办，打...</td>\n",
" <td>出现此情况一般是有以下几种情况：1、信息可能发错接收人了。2、此卡为二次放号的手机卡，前一个...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>35555</th>\n",
" <td>就是联通网用不了。</td>\n",
" <td>NaN</td>\n",
" <td>如使用联通手机无法上网，可做以下排查：1、升级为4G套餐后如不重启手机则无法正常使用上网功能...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>73496</th>\n",
" <td>生份证复印件被公司拿去开联通号码了怎么办</td>\n",
" <td>生份证复印件被公司拿去开联通号码了怎么办</td>\n",
" <td>你再用原件去注销</td>\n",
" <td>0</td>\n",
" </tr>\n",
" <tr>\n",
" <th>114899</th>\n",
" <td>手机有4g网络，可是却显示无法上网</td>\n",
" <td>NaN</td>\n",
" <td>1、检查信号是否正常；2、号卡是否欠费；3、如上面2项都正常，可重新开关机、换机换卡测试；4...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" <tr>\n",
" <th>47230</th>\n",
" <td>移动，联通无限打到底是怎么回事</td>\n",
" <td>NaN</td>\n",
" <td>您好！现运营商均有推出各种语音、流量优惠套餐，具体情况建议您可咨询当地客服热线、实体营业厅、...</td>\n",
" <td>1</td>\n",
" </tr>\n",
" </tbody>\n",
"</table>\n",
"</div>"
],
"text/plain": [
" title \\\n",
"104525 拖欠联通话费会有利息出现吗？ \n",
"116168 5S日版为什么插移动卡可以用.联通卡就不读卡 \n",
"154475 联通空中号激活了也不能打电话是怎么回事 \n",
"153069 联通48元送2g活动本月月租到底算不算进去？ \n",
"195043 VI###13是不是不支持联通上网卡 \n",
"5235 电话号码能定位是真吗 \n",
"10472 索尼LT22i可以刷机到4.1吗 \n",
"86083 苹果ip##ne手机的个人热点怎么设置使用 \n",
"150247 我用的联通的号码，信号一会有一会没有，请问到底是怎什么回事 \n",
"202724 流量畅享包订购生效时间 \n",
"44450 办了腾讯大王卡，激活后，身份证是不是就剩下半俩张卡的机会了 \n",
"65875 现在有联通的合约机吗 \n",
"51934 联通卡那个腾讯应用省内定向流量免费是什么意思啊 \n",
"155866 怎么设置电信手机彩铃？ \n",
"118696 联通手机号挂失还能交费吗 \n",
"115890 我刚买了一张联通卡，过了几天我怎么收到达飞即有分期让我还款的信息 \n",
"35555 就是联通网用不了。 \n",
"73496 生份证复印件被公司拿去开联通号码了怎么办 \n",
"114899 手机有4g网络，可是却显示无法上网 \n",
"47230 移动，联通无限打到底是怎么回事 \n",
"\n",
" question \\\n",
"104525 NaN \n",
"116168 NaN \n",
"154475 联通空中号激活了也不能打电话是怎么回事 \n",
"153069 NaN \n",
"195043 NaN \n",
"5235 电话号码能定位是真吗 \n",
"10472 NaN \n",
"86083 NaN \n",
"150247 NaN \n",
"202724 NaN \n",
"44450 办了腾讯大王卡，激活后，身份证是不是就剩下半俩张卡的机会了 \n",
"65875 NaN \n",
"51934 NaN \n",
"155866 NaN \n",
"118696 NaN \n",
"115890 我刚买了一张联通卡，过了几天我怎么收到达飞即有分期让我还款的信息，我又没有借过，该怎么办，打... \n",
"35555 NaN \n",
"73496 生份证复印件被公司拿去开联通号码了怎么办 \n",
"114899 NaN \n",
"47230 NaN \n",
"\n",
" reply is_best \n",
"104525 应该没有 0 \n",
"116168 苹果手机卡贴分为移动和联通的，说明卡贴支持移动卡，不支持联通卡，主要是网络制式决定的。联通网... 1 \n",
"154475 手机已激活却无法接打电话的常见原因及解决方法如下：【1】检查手机是否欠费停机，建议缴费充值；... 1 \n",
"153069 算 1 \n",
"195043 VI###13支持联通上网卡。网络参考：主屏尺寸：4.5英寸主屏分辨率：854x480像素后... 1 \n",
"5235 当然了 0 \n",
"10472 由于手机所支持的网络是由硬件所确定的，无法通过破解软件或者升级软件系统让手机支持其他运营商的... 1 \n",
"86083 1、点击“设置”选项;2、在“设置”界面中找到“个人热点”;3、然后我们可以看到“个人热点”... 0 \n",
"150247 信号不好，手机因素，运营商问题，手机卡问题，很多因素你可以到当地联通营业厅寻求帮助 0 \n",
"202724 您订购沃商店/沃游戏流量畅享包后，订购当月立即生效，按月自动续订；退订月底生效，当月可继续使... 1 \n",
"44450 每人仅可预约一张音乐小*卡或视频小*卡或腾讯大*卡或腾讯天*卡（一共仅1张）（识别条件为：联... 1 \n",
"65875 联通有合约机。合约种类大致有存话费送手机、买手机送话费、合约惠机等，具体合约种类可登录联通网... 0 \n",
"51934 大王卡，对腾讯的应用，都免流量！ 0 \n",
"155866 设置中*电信的彩铃可以自己在网上操作的，前提是先开通中*电信的彩铃业务，可以直接致电电信客服... 1 \n",
"118696 1、挂失状态下可以交费。交费渠道与手机正常状态下是一样的。2、温馨提示：如果号码有套餐，挂失... 1 \n",
"115890 出现此情况一般是有以下几种情况：1、信息可能发错接收人了。2、此卡为二次放号的手机卡，前一个... 1 \n",
"35555 如使用联通手机无法上网，可做以下排查：1、升级为4G套餐后如不重启手机则无法正常使用上网功能... 1 \n",
"73496 你再用原件去注销 0 \n",
"114899 1、检查信号是否正常；2、号卡是否欠费；3、如上面2项都正常，可重新开关机、换机换卡测试；4... 1 \n",
"47230 您好！现运营商均有推出各种语音、流量优惠套餐，具体情况建议您可咨询当地客服热线、实体营业厅、... 1 "
]
},
"execution_count": 4,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"pd_all.sample(n=20)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.0"
}
},
"nbformat": 4,
"nbformat_minor": 2
}