Python crawling data saved in txt format

Answer 1

There are several ways to save data in txt-format in Python:
1. Using the open and write functions:
- If you want to save string or byte-type data (but you can't directly save arrays), you can use this method. For example, the following code saves a string to the test.txt:
```python
test = "This is a test string"
with open('test.txt', 'w') as f:
f.write(test)
```
2. Using the np.save function:
- This method can be used to save array type data to a txt-file. For example, if there is an array to save:
```python
import numpy as np
test = np.array([1, 2, 3])
np.save('test.txt', test, fmt='%d')
```
3. When it comes to saving the data as a txt-file after data crawling, if you use the pandas library to read the data, for example, read the data from the dsv file and save it as a txt-file:
- Method 1: Store the data in the data frame into a txt-file (using the pandas library). If the data is read from a file called train_dataset.dsv., the code is as follows:
```python
import pandas as pd
data_train = pd.read_csv("train_dataset.csv", encoding='utf - 8',sep='|')
train_content = pd.DataFrame(data_train.content)
train_content.to_csv("train_content.txt",sep ="\t",index=False)
```
- Method 2: Save the string to a txt-file:
```python
# file=open("train_content.txt',"w") #" w "for writing" w+"for reading and writing
# file.write(train_content)
# file.close()
```
4. To save the crawled data in a specific format (such as saving the data as txy after serializing it):
- Save in JSon sequence (suitable for converting objects such as a dictionary into a JSon string and saving it to txttext):
```python
import json
data = {"name": "Alice", "age": 25}
json_data = json.dumps(data)
with open('data.txt', 'w') as f:
f.write(json_data)
```
- If you use Pickle to serialize (convert Python objects into a sequence of words, save them, and then de-serialize them when you read them):
```python
import pickle
data = {"name": "Alice", "age": 25}
serialized_data = pickle.dumps(data)
with open('data.txt', 'wb') as f:
f.write(serialized_data)
```
- Xml serializing (convert the data into an Xml element, serialize it into a string, and save it in txt):
```python
import xml.etree.ElementTree as ET
data = {"name": "Alice", "age": 25}
root = ET.Element("data")
for key, value in data.items():
child = ET.SubElement(root, key)
child.text = str(value)
xml_data = ET.tostring(root, encoding="utf - 8", method="xml")
with open('data.txt', 'w') as f:
f.write(xml_data.decode())
```
Read more exciting novels for free