Corrupted configuration and batch_input_shape (Loading pre-trained layers model in tensorflow.js )

[goblincat]

Hi! I’m trying to load my pre-trained layers model into a node.js app. When loading, I got this error:

ValueError: An InputLayer should be passed either a `batchInputShape` or an `inputShape`.

I assumed this was because the InputLayer in my model.json file had the property “batch_shape” instead of “batch_input_shape” and changed it in all relevant layers. I am now getting this error:

ValueError: Corrupted configuration, expected array for nodeData: [object Object]

Here are my questions:

• Did manually changing batch_shape to batch_input_shape cause this error, or is this another error? (I am leaning towards the latter, since changing the name of an attribute wouldn’t change the data type?)
• What is causing the “Corrupted configuration” error? I don’t see a “nodeData” in my model.json file
• Is there documentation for what type every attribute should be in a model.json file? Or, does anyone have an example of a functional model.json file for a layers-model I can check mine against?

My models.json file is too long to include here, so here’s a link to the file: https://www.file.io/BjSr/download/DQTe2Pqhilcq

Additional information:

• Model was trained following this tutorial almost exactly
• Model was converted to json using these steps

Thank you so much for your help! Let me know if I should provide additional info

[abimdanu]

Hi! Is this solved? As I’m currently stumbling into this error (when loading) as well.

[boerme]

Having the same problem here.
A working model saved converted with tfjs.converters.save_keras_model(new_model, ‘js-model’) resulting in model.json and group1-shard1of1.bin.

Loading in nodejs with

const handler = tf.io.fileSystem(MODEL_PATH);
  const model = await tf.loadLayersModel(handler);

results in the “batchInputShape” error.

[Rahul_Gaikwad]

Hi, @goblincat, @abimdanu @boerme

Welcome to TensorFlow Forum!

I apologize for the delayed response and thank you for bringing this issue to our attention, if possible could you please help us with your Github repo or codepen example along with converted TensorFlow.js model (@goblincat I’m getting error while accessing your model files) and complete steps to replicate the same behavior from our end to investigate this issue further from our end ?

Thank you for your cooperation and patience

[boerme]

I found out that that I can’t even load the saved model with load_keras_model in the same environment:

tfjs.converters.save_keras_model(model, 'js-model')

new_model = tfjs.converters.load_keras_model('js-model/model.json')
Exception encountered: Unrecognized keyword arguments: ['batch_shape']

Perhaps that would be a good place to start while some of us gets something set up in github.
Btw. I’m on a mac m1 with python 3.11, tensorflow 2.16.1, tensorflow-metal 1.1.0 and tensorflowjs 4.20.0

[goblincat]

Hi Rahul!
Thanks for the response! I have reuploaded my model here. The function I’m trying to run is just this:

const tfn = require("@tensorflow/tfjs-node");
const handler = tfn.io.fileSystem("./model.json");
let model;

async function getModel() {
    if (!model) {
      model = await tfn.loadLayersModel(handler);
    }
    return model;
};

[Mah_Neh]

Can you load the model and run inferences from Python ? Just to rule out whether it’s conversion or model/training/saving issues.

[goblincat]

I’ve been able to reload my model in Python but it looks like Boerme in the previous reply can’t

[Ian_McNaughton]

Hello,

Has anyone made any progress on this, I just started running into this error yesterday trying to convert a model trained in python 3.11 with tensorflow 2.16.1 to run with tensorflowjs 4.20.0

The steps I have taken are almost identical to goblincat in the original post,

I was going to start looking into this tonight but was curious what others had done for this, I was going to start in the TFJS code to better understand what is expected of the model.json and see if there had been any recent changes in the tensorflowjs python package to the code that saves the json, but I do not want to repeat any work others have done,

[Ian_McNaughton]

Just to follow up on this, it looks like the inbound_nodes array in each layer object has become much more dense than it was, in previous versions.

I see a change from

"inbound_nodes": [
                            [
                                [
                                    "concatenate",
                                    0,
                                    0,
                                    {}
                                ]
                            ]
                        ]

to

"inbound_nodes": [
                            {
                                "args": [
                                    {
                                        "class_name": "__keras_tensor__",
                                        "config": {
                                            "shape": [
                                                null,
                                                4146
                                            ],
                                            "dtype": "float32",
                                            "keras_history": [
                                                "concatenate",
                                                0,
                                                0
                                            ]
                                        }
                                    }
                                ],
                                "kwargs": {}
                            }
                        ]

Also as stated above, there seems to be a change where batch_input_shape has changed to batch_shape

after manually adjusting the model.json file to rename batch_shape to batch_input_shape and simplify the inbound_nodes array of each layer, I am able to load the modified model.json file using tensorflowjs 4.20.0’s loadLayersModel method.

[Ian_McNaughton]

I have created an issue on the tfjs github page, tfjs.converters.save_keras_model producing model.json file that does not parse properly. · Issue #8328 · tensorflow/tfjs · GitHub

and I have a demo of this issue GitHub - imcnaugh/tfjs_issue_demo: This is a demo of an issue I have been looking at with tensorflowjs

[Mah_Neh]

But isn’t this because you are now using keras 3 by default with 2.16 @Ian_McNaughton ?

You can check the version using python -c 'import keras; print(keras.__version__)' I think.

You need to install keras 2, otherwise it’s saving a keras tensor.

Starting with TensorFlow 2.16, doing pip install tensorflow will install Keras 3. When you have TensorFlow >= 2.16 and Keras 3, then by default from tensorflow import keras (tf.keras) will be Keras 3.

Source

[Ian_McNaughton]

Yup, your right, I was caught in dependency hell, and missed the Keras documentation,

Setting the environment variable TF_USE_LEGACY_KERAS=1 has my project working. Ugh I hate it when i miss tiny things like that.

But thank you.

[Mah_Neh]

np, feel free to add that / copy that to your GH issue to help others. i don’t use github.
good luck.