# verify_mindnlp_gpt_bigcode

**Repository Path**: neoming/verify_mindnlp_gpt_bigcode

## Basic Information

- **Project Name**: verify_mindnlp_gpt_bigcode
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2023-10-31
- **Last Updated**: 2023-10-31

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Verify `GPT_BIGCODE` for `MindNLP`

## How to run this code

```
git clone https://gitee.com/neoming/verify_mindnlp_gpt_bigcode.git
cd verify_mindnlp_gpt_bigcode
python test_gpt_bigcode.py
```
## Files Description
```
.
├── README.md                           # this file
├── outputs                             # dir to store hf/ms model output
│   ├── hf_model_output
│   └── ms_model_output
├── test_gpt_bigcode.py                 # test ms model with from_pretrained and compare result with hf model
└── verify.log                          # my pass run log
```
## Requirement
+ Python            3.7.5
+ MindSpore         2.1.1
+ MindNLP
+ troubleshooter
+ Transformer

## PASS Log

You should get output like this
```
+-------------------------------------------------------------------------------------------------------------------------------------------+
|                                                       The list of comparison results                                                      |
+------------------------------------+----------------------+--------------------+-------------------+-------------------+------------------+
|          orig array name           |  target array name   | result of allclose | ratio of allclose | cosine similarity | mean & max diffs |
+------------------------------------+----------------------+--------------------+-------------------+-------------------+------------------+
| 0_hf_output_last_hidden_state.npy  |  1_ms_output_0.npy   |        True        |      100.00%      |      0.99999      | 0.00000, 0.00032 |
| 0_hf_output_past_key_values_0.npy  | 1_ms_output_1_0.npy  |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_1.npy  | 1_ms_output_1_1.npy  |        True        |      100.00%      |      0.99999      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_10.npy | 1_ms_output_1_10.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_11.npy | 1_ms_output_1_11.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_12.npy | 1_ms_output_1_12.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_13.npy | 1_ms_output_1_13.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_14.npy | 1_ms_output_1_14.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_15.npy | 1_ms_output_1_15.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_16.npy | 1_ms_output_1_16.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_17.npy | 1_ms_output_1_17.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_18.npy | 1_ms_output_1_18.npy |        True        |      100.00%      |      0.99999      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_19.npy | 1_ms_output_1_19.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_2.npy  | 1_ms_output_1_2.npy  |        True        |      100.00%      |      0.99999      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_20.npy | 1_ms_output_1_20.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_21.npy | 1_ms_output_1_21.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_22.npy | 1_ms_output_1_22.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_23.npy | 1_ms_output_1_23.npy |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_3.npy  | 1_ms_output_1_3.npy  |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_4.npy  | 1_ms_output_1_4.npy  |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_5.npy  | 1_ms_output_1_5.npy  |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_6.npy  | 1_ms_output_1_6.npy  |        True        |      100.00%      |      0.99999      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_7.npy  | 1_ms_output_1_7.npy  |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_8.npy  | 1_ms_output_1_8.npy  |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
| 0_hf_output_past_key_values_9.npy  | 1_ms_output_1_9.npy  |        True        |      100.00%      |      1.00000      | 0.00000, 0.00000 |
+------------------------------------+----------------------+--------------------+-------------------+-------------------+------------------+
```