Yes, you can import Items records.
Steps for the same are as follows:

1. Click on the More button
2. Click on the Import Items button.
3. Choose the CSV file.
4. Click Upload file.