Merge pull request #1114 from zmeihui/23-10-25-release-note

Add the release notes for v4.1.0

Author: lzjpaul

NOTICE

@@ -32,3 +32,14 @@ developers of Apache SINGA under Apache License, Version 2.0.
 ./doc/_static/images/singav1-sw.png
 ./examples/model_selection/TRAILS-Database-Native-Model-Selection/documents/image-20231020174425377.png
 ./examples/model_selection/TRAILS-Database-Native-Model-Selection/documents/image-20231020174945226.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230421214835152.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230421220338391.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230421220443231.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230702035554579.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230702035622198.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230702035639502.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230702035806963.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230722202555763.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230722205244718.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230724111325368.png
+./examples/model_selection/TRAILS-Database-Native-Model-Selection/internal/ml/model_selection/documents/imgs/image-20230724111659545.png

RELEASE_NOTES

@@ -1,3 +1,40 @@
+Release Notes - SINGA - Version singa-4.1.0
+
+SINGA is a distributed deep learning library.
+
+This release includes following changes:
+
+  * New examples
+    * Add an example for malaria detection using cell images.
+    * Add an example for structured data learning.
+
+  * Add support for models running on top of RDBMS
+    * Add support for in-database model definition and selection in RDBMS.
+    * Implement training-free model evaluation metrics for in-database model selection.
+    * Implement a coordinator to balance between training-free and training-based model evaluations 
+      for in-database model selection.
+    
+  * Enhance distributed training
+    * Add implementations for the sum error loss.
+    * Improve the optimizer to return model gradients.
+    * Improve the iterative checking for tensors and strings in the ModelMeta class.
+    
+  * Enhance example code
+    * Add support for flexible setting of training configurations for models, e.g., learning rates, 
+      weight decay, momentum, etc.
+    * Add implementations for dynamic models with varying layer sizes.
+
+  * Update the website
+    * Add illustrations for database integration.
+    * Update users of Apache SINGA.
+
+  * Fix bugs
+    * Update the NVIDIA_GPGKEY in the Dockerfile for building wheel files.
+    * Update the versions of dependencies in the wheel file.
+    * Fix the collections module in the model.py file.
+
+----------------------------------------------------------------------------------------------
+
 Release Notes - SINGA - Version singa-4.0.0
 
 SINGA is a distributed deep learning library.

examples/model_selection/TRAILS-Database-Native-Model-Selection/documents/dev_guide.md

@@ -1,20 +1,21 @@
-#
-# Licensed to the Apache Software Foundation (ASF) under one
-# or more contributor license agreements.  See the NOTICE file
-# distributed with this work for additional information
-# regarding copyright ownership.  The ASF licenses this file
-# to you under the Apache License, Version 2.0 (the
-# "License"); you may not use this file except in compliance
-# with the License.  You may obtain a copy of the License at
-#
-#     http://www.apache.org/licenses/LICENSE-2.0
-#
-# Unless required by applicable law or agreed to in writing, software
-# distributed under the License is distributed on an "AS IS" BASIS,
-# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-# See the License for the specific language governing permissions and
-# limitations under the License.
-#
+<!--
+    Licensed to the Apache Software Foundation (ASF) under one
+    or more contributor license agreements.  See the NOTICE file
+    distributed with < this work for additional information
+    regarding copyright ownership.  The ASF licenses this file
+    to you under the Apache License, Version 2.0 (the
+    "License"); you may not use this file except in compliance
+    with the License.  You may obtain a copy of the License at
+
+      http://www.apache.org/licenses/LICENSE-2.0
+
+    Unless required by applicable law or agreed to in writing,
+    software distributed under the License is distributed on an
+    "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+    KIND, either express or implied.  See the License for the
+    specific language governing permissions and limitations
+    under the License.
+-->
 
 # Change the permission