Merge branch 'main' into user/tpellissier/prefix-with-schemaname

Author: tpellissier

.github/workflows/python-package.yml

@@ -28,7 +28,7 @@ jobs:
       run: |
         python -m pip install --upgrade pip
         python -m pip install flake8 black build
-        if [ -f dev_dependencies.txt ]; then pip install -r dev_dependencies.txt; fi
+        python -m pip install -e .[dev]
     
     - name: Check format with black
       continue-on-error: true  # TODO: fix detected formatting errors and remove this line.

CHANGELOG.md

@@ -2,20 +2,42 @@
 
 All notable changes to this project will be documented in this file.
 
-The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
-and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
-
-## [Unreleased]
+## [0.1.0b1] - 2025-11-14
 
 ### Added
-- Initial SDK implementation with CRUD operations
-- Service principal authentication support
-- Interactive browser authentication support
-- SQL query execution via `query_sql()`
-- File upload capabilities
-- Pandas integration for query results
-- Structured error handling with specific exception types
-- GitHub Actions CI pipeline for automated testing
+**Initial beta release** of Microsoft Dataverse SDK for Python
+
+**Core Client & Authentication:**
+- Core `DataverseClient` with Azure Identity authentication support
+- Secure authentication using Azure Identity credentials (Service Principal, Managed Identity, Interactive Browser)
+- TLS 1.2+ encryption for all API communications
+- Proper credential handling without exposing secrets in logs
+
+**Data Operations:**
+- Complete CRUD operations (create, read, update, delete) for Dataverse records
+- Advanced OData query support with filtering, sorting, and expansion
+- SQL query execution via `query_sql()` method with result pagination
+- Support for batch operations and transaction handling
+- File upload capabilities for file and image columns
+
+**Table Management:**
+- Table metadata operations (create, inspect, delete custom tables)
+
+**Integration & Analysis:**
+- Pandas DataFrame integration for seamless data analysis workflows
+
+**Reliability & Error Handling:**
+- Comprehensive error handling with specific exception types (`DataverseError`, `AuthenticationError`, etc.)
+- HTTP retry logic with exponential backoff for resilient operations
+
+**Developer Experience:**
+- Example scripts demonstrating common integration patterns
+- Complete documentation with quickstart guides and API reference
+- Modern Python packaging using `pyproject.toml` configuration
+
+**Quality Assurance:**
+- Comprehensive test suite with unit and integration tests
+- GitHub Actions CI/CD pipeline for automated testing and validation
 - Azure DevOps PR validation pipeline
 
 ### Changed
@@ -32,42 +54,3 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ### Security
 - N/A
-
-## [0.1.0] - TBD
-
-### Added
-- First alpha release
-- Core Dataverse client with authentication
-- Basic CRUD operations (create, get, update, delete)
-- OData query support
-- SQL query support
-- Error handling framework
-- Example scripts for common scenarios
-
----
-
-## Release Notes Template
-
-When creating a new release, copy this template:
-
-```markdown
-## [X.Y.Z] - YYYY-MM-DD
-
-### Added
-- New features
-
-### Changed
-- Changes in existing functionality
-
-### Deprecated
-- Soon-to-be removed features
-
-### Removed
-- Removed features
-
-### Fixed
-- Bug fixes
-
-### Security
-- Security improvements or fixes
-```

README.md

@@ -6,7 +6,7 @@
 
 A Python client library for Microsoft Dataverse that provides a unified interface for CRUD operations, SQL queries, table metadata management, and file uploads through the Dataverse Web API.
 
-**[Source code](https://github.com/microsoft/PowerPlatform-DataverseClient-Python)** | **[Package (PyPI)](https://pypi.org/project/PowerPlatform-Dataverse-Client/)** | **[API reference documentation](https://github.com/microsoft/PowerPlatform-DataverseClient-Python/tree/main/examples)** | **[Product documentation](https://learn.microsoft.com/power-apps/developer/data-platform/)** | **[Samples](https://github.com/microsoft/PowerPlatform-DataverseClient-Python/tree/main/examples)**
+**[Source code](https://github.com/microsoft/PowerPlatform-DataverseClient-Python)** | **[Package (PyPI)](https://pypi.org/project/PowerPlatform-Dataverse-Client/)** | **[API reference documentation](https://learn.microsoft.com/en-us/power-apps/developer/data-platform/sdk-python/)** | **[Product documentation](https://learn.microsoft.com/en-us/python/api/dataverse-sdk-docs-python/dataverse-overview?view=dataverse-sdk-python-latest/)** | **[Samples](https://github.com/microsoft/PowerPlatform-DataverseClient-Python/tree/main/examples)**
 
 > [!IMPORTANT]
 > This library is currently in **preview**. Preview versions are provided for early access to new features and may contain breaking changes.

SUPPORT.md

@@ -1,25 +1,27 @@
-# TODO: The maintainer of this repo has not yet edited this file
+# Support
 
-**REPO OWNER**: Do you want Customer Service & Support (CSS) support for this product/project?
+## How to file issues and get help
 
-- **No CSS support:** Fill out this template with information about how to file issues and get help.
-- **Yes CSS support:** Fill out an intake form at [aka.ms/onboardsupport](https://aka.ms/onboardsupport). CSS will work with/help you to determine next steps.
-- **Not sure?** Fill out an intake as though the answer were "Yes". CSS will help you decide.
+This project uses GitHub Issues to track bugs and feature requests. Please search the existing 
+issues before filing new issues to avoid duplicates. For new issues, file your bug or 
+feature request as a new Issue.
 
-*Then remove this first heading from this SUPPORT.MD file before publishing your repo.*
+### Getting Help
 
-# Support
+For help and questions about using the Microsoft Dataverse SDK for Python:
 
-## How to file issues and get help  
+- **Documentation**: Check the [README](README.md) for quickstart guides and examples
+- **GitHub Issues**: [File an issue](https://github.com/microsoft/PowerPlatform-DataverseClient-Python/issues) for bugs or feature requests
 
-This project uses GitHub Issues to track bugs and feature requests. Please search the existing 
-issues before filing new issues to avoid duplicates.  For new issues, file your bug or 
-feature request as a new Issue.
+### Reporting Security Issues
+
+Security issues should be reported privately via the [Microsoft Security Response Center (MSRC)](https://aka.ms/opensource/security/msrc) or by emailing [secure@microsoft.com](mailto:secure@microsoft.com). Please do not report security vulnerabilities through public GitHub issues.
+
+## Microsoft Support Policy
 
-For help and questions about using this project, please **REPO MAINTAINER: INSERT INSTRUCTIONS HERE 
-FOR HOW TO ENGAGE REPO OWNERS OR COMMUNITY FOR HELP. COULD BE A STACK OVERFLOW TAG OR OTHER
-CHANNEL. WHERE WILL YOU HELP PEOPLE?**.
+This is a community-supported project. Support for the Microsoft Dataverse SDK for Python is provided on a best-effort basis through:
 
-## Microsoft Support Policy  
+- Community contributions via GitHub Issues and Pull Requests
+- Documentation and examples in this repository
 
-Support for this **PROJECT or PRODUCT** is limited to the resources listed above.
+This project is not covered by Microsoft's standard product support services. For issues with Microsoft Dataverse itself (not this SDK), please use the official Microsoft support channels.

dev_dependencies.txt

@@ -8,25 +8,4 @@
 configuration, HTTP client, and error handling.
 """
 
-from .auth import AuthManager, TokenPair
-from .config import DataverseConfig
-from .errors import (
-    DataverseError,
-    HttpError,
-    ValidationError,
-    MetadataError,
-    SQLParseError,
-)
-from .http import HttpClient
-
-__all__ = [
-    "AuthManager",
-    "TokenPair",
-    "DataverseConfig",
-    "DataverseError",
-    "HttpError",
-    "ValidationError",
-    "MetadataError",
-    "SQLParseError",
-    "HttpClient",
-]
+__all__ = []

requirements.txt

@@ -53,7 +53,7 @@ def __init__(
         self.details = details or {}
         self.source = source or "client"
         self.is_transient = is_transient
-        self.timestamp = _dt.datetime.utcnow().isoformat() + "Z"
+        self.timestamp = _dt.datetime.now(_dt.timezone.utc).isoformat().replace('+00:00', 'Z')
 
     def to_dict(self) -> Dict[str, Any]:
         """

src/PowerPlatform/Dataverse/core/__init__.py

@@ -8,7 +8,4 @@
 SQL query functionality, and file upload capabilities.
 """
 
-from .odata import ODataClient
-from .upload import ODataFileUpload
-
-__all__ = ["ODataClient", "ODataFileUpload"]
+__all__ = []

src/PowerPlatform/Dataverse/core/errors.py

@@ -17,7 +17,18 @@
 from ..core.http import HttpClient
 from .upload import ODataFileUpload
 from ..core.errors import *
-from ..core import error_codes as ec
+from ..core.error_codes import (
+    http_subcode, 
+    is_transient_status,
+    VALIDATION_SQL_NOT_STRING,
+    VALIDATION_SQL_EMPTY,
+    METADATA_ENTITYSET_NOT_FOUND,
+    METADATA_ENTITYSET_NAME_MISSING,
+    METADATA_TABLE_NOT_FOUND,
+    METADATA_TABLE_ALREADY_EXISTS,
+    METADATA_COLUMN_NOT_FOUND,
+    VALIDATION_UNSUPPORTED_CACHE_KIND,
+)
 
 from ..__version__ import __version__ as _SDK_VERSION
 
@@ -147,7 +158,7 @@ def _request(self, method: str, url: str, *, expected: tuple[int, ...] = (200, 2
         except Exception:
             pass
         sc = r.status_code
-        subcode = ec.http_subcode(sc)
+        subcode = http_subcode(sc)
         correlation_id = headers.get("x-ms-correlation-request-id") or headers.get("x-ms-correlation-id")
         request_id = headers.get("x-ms-client-request-id") or headers.get("request-id") or headers.get("x-ms-request-id")
         traceparent = headers.get("traceparent")
@@ -158,7 +169,7 @@ def _request(self, method: str, url: str, *, expected: tuple[int, ...] = (200, 2
                 retry_after = int(ra)
             except Exception:
                 retry_after = None
-        is_transient = ec.is_transient_status(sc)
+        is_transient = is_transient_status(sc)
         raise HttpError(
             msg,
             status_code=sc,
@@ -487,23 +498,23 @@ def _delete(self, table_schema_name: str, key: str) -> None:
         url = f"{self.api}/{entity_set}{self._format_key(key)}"
         self._request("delete", url, headers={"If-Match": "*"})
 
-    def _get(self, table_schema_name: str, key: str, select: Optional[str] = None) -> Dict[str, Any]:
+    def _get(self, table_schema_name: str, key: str, select: Optional[List[str]] = None) -> Dict[str, Any]:
         """Retrieve a single record.
 
         :param table_schema_name: Schema name of the table.
         :type table_schema_name: ``str``
         :param key: Record GUID (with or without parentheses).
         :type key: ``str``
-        :param select: Comma separated columns for ``$select`` (optional).
-        :type select: ``str`` | ``None``
+        :param select: Columns to select; joined with commas into $select.
+        :type select: ``list[str]`` | ``None``
 
         :return: Retrieved record dictionary (may be empty if no selected attributes).
         :rtype: ``dict[str, Any]``
         """
         params = {}
         if select:
             # Lowercase column names for case-insensitive matching
-            params["$select"] = select.lower()
+            params["$select"] = ",".join(select)
         entity_set = self._entity_set_from_schema_name(table_schema_name)
         url = f"{self.api}/{entity_set}{self._format_key(key)}"
         r = self._request("get", url, params=params)
@@ -605,9 +616,9 @@ def _query_sql(self, sql: str) -> list[dict[str, Any]]:
            Endpoint form: ``GET /{entity_set}?sql=<encoded select>``. The client extracts the logical table name, resolves the entity set (metadata cached), then issues the request. Only a constrained SELECT subset is supported by the platform.
         """
         if not isinstance(sql, str):
-            raise ValidationError("sql must be a string", subcode=ec.VALIDATION_SQL_NOT_STRING)
+            raise ValidationError("sql must be a string", subcode=VALIDATION_SQL_NOT_STRING)
         if not sql.strip():
-            raise ValidationError("sql must be a non-empty string", subcode=ec.VALIDATION_SQL_EMPTY)
+            raise ValidationError("sql must be a non-empty string", subcode=VALIDATION_SQL_EMPTY)
         sql = sql.strip()
 
         # Extract logical table name via helper (robust to identifiers ending with 'from')
@@ -683,14 +694,14 @@ def _entity_set_from_schema_name(self, table_schema_name: str) -> str:
             plural_hint = " (did you pass a plural entity set name instead of the singular table schema name?)" if table_schema_name.endswith("s") and not table_schema_name.endswith("ss") else ""
             raise MetadataError(
                 f"Unable to resolve entity set for table schema name '{table_schema_name}'. Provide the singular table schema name.{plural_hint}",
-                subcode=ec.METADATA_ENTITYSET_NOT_FOUND,
+                subcode=METADATA_ENTITYSET_NOT_FOUND,
             )
         md = items[0]
         es = md.get("EntitySetName")
         if not es:
             raise MetadataError(
                 f"Metadata response missing EntitySetName for table schema name '{table_schema_name}'.",
-                subcode=ec.METADATA_ENTITYSET_NAME_MISSING,
+                subcode=METADATA_ENTITYSET_NAME_MISSING,
             )
         self._logical_to_entityset_cache[cache_key] = es
         primary_id_attr = md.get("PrimaryIdAttribute")
@@ -1195,7 +1206,7 @@ def _delete_table(self, table_schema_name: str) -> None:
         if not ent or not ent.get("MetadataId"):
             raise MetadataError(
                 f"Table '{table_schema_name}' not found.",
-                subcode=ec.METADATA_TABLE_NOT_FOUND,
+                subcode=METADATA_TABLE_NOT_FOUND,
             )
         metadata_id = ent["MetadataId"]
         url = f"{self.api}/EntityDefinitions({metadata_id})"
@@ -1232,7 +1243,7 @@ def _create_table(
         if ent:
             raise MetadataError(
                 f"Table '{table_schema_name}' already exists.",
-                subcode=ec.METADATA_TABLE_ALREADY_EXISTS,
+                subcode=METADATA_TABLE_ALREADY_EXISTS,
             )
 
         created_cols: List[str] = []
@@ -1301,7 +1312,7 @@ def _create_columns(
         if not ent or not ent.get("MetadataId"):
             raise MetadataError(
                 f"Table '{table_schema_name}' not found.",
-                subcode=ec.METADATA_TABLE_NOT_FOUND,
+                subcode=METADATA_TABLE_NOT_FOUND,
             )
 
         metadata_id = ent.get("MetadataId")
@@ -1362,7 +1373,7 @@ def _delete_columns(
         if not ent or not ent.get("MetadataId"):
             raise MetadataError(
                 f"Table '{table_schema_name}' not found.",
-                subcode=ec.METADATA_TABLE_NOT_FOUND,
+                subcode=METADATA_TABLE_NOT_FOUND,
             )
 
         # Use the actual SchemaName from the entity metadata
@@ -1376,7 +1387,7 @@ def _delete_columns(
             if not attr_meta:
                 raise MetadataError(
                     f"Column '{column_name}' not found on table '{entity_schema}'.",
-                    subcode=ec.METADATA_COLUMN_NOT_FOUND,
+                    subcode=METADATA_COLUMN_NOT_FOUND,
                 )
 
             attr_metadata_id = attr_meta.get("MetadataId")
@@ -1418,7 +1429,7 @@ def _flush_cache(
         if k != "picklist":
             raise ValidationError(
                 f"Unsupported cache kind '{kind}' (only 'picklist' is implemented)",
-                subcode=ec.VALIDATION_UNSUPPORTED_CACHE_KIND,
+                subcode=VALIDATION_UNSUPPORTED_CACHE_KIND,
             )
 
         removed = len(self._picklist_label_cache)