https://stackoverflow.com/questions/18594504
italiano
english
français
española
中国
日本の
العربية
Deutsch
한국어
Português
RussianFinally got to the bottom of the broken pipe error I encountered.
The broken pipe error was being thrown due to my not closing down certain database connections from within the Talend jobs. These connections at issue were connections that were defined in native java (via the tJava component). It was incorrectly assumed by me that by referencing a previously defined connection (for connection attributes), the connection resources would be closed and released.
With the above in mind, I was actually creating a new connection as listed below and had to specifically commit the connection and then close it out. The item to take note of here is the use of the commit on the connection. The broken pipe error was still being thrown with just the close of the connection. It was not until the commit was added did the broken pipe errors cease and that was due to the connection being closed properly.
Hindsight being what it is... when using the Talend components (and not native java code) for the connection definition and closing of that connection, the autoCommit feature is available to the tMysqlCOnnection as well as the commit option being available for the close connection option being available on the tMysqlCommit component. These two options allow for the prevention of a broken pipe error and is why I only encountered broken pipe errors with the connections used by the tJava components. Makes sense now.
// code snippet from the tJava component using native java to read a table.
java.sql.Connection tableConnection = null;
tableConnection = (java.sql.Connection) globalMap.get("conn_tMysqlConnection_1");
Statement selectStatement = tableConnection.createStatement();
// Execute statement to get the row count from the table.
ResultSet resultSet = selectStatement.executeQuery("select count(*) from tableA");
// Position the result set to allow for access of its information.
resultSet.next();
// Get the row count from the result set.
context.numberOfRows = resultSet.getInt(1);
resultSet.close();
selectStatement.close();
tableConnection.commit();
tableConnection.close();
And... I would be remiss if I did not mention that I found out about needing to use the commit by an article on the following link. http://mikeschubert.com/2006/08/03/javanetsocketex/
