Metadata-Version: 2.1
Name: sqlitebiter
Version: 0.19.0
Summary: A CLI tool to convert CSV / Excel / HTML / JSON / Jupyter Notebook / LDJSON / LTSV / Markdown / SQLite / SSV / TSV / Google-Sheets to a SQLite database file.
Home-page: https://github.com/thombashi/sqlitebiter
Author: Tsuyoshi Hombashi
Author-email: tsuyoshi.hombashi@gmail.com
License: MIT License
Project-URL: Documentation, http://sqlitebiter.rtfd.io/
Project-URL: Tracker, https://github.com/thombashi/sqlitebiter/issues
Description: **sqlitebiter**
        
        .. contents:: Table of Contents
           :depth: 2
        
        Summary
        =========
        A CLI tool to convert CSV / Excel / HTML / JSON / Jupyter Notebook / LDJSON / LTSV / Markdown / SQLite / SSV / TSV / Google-Sheets to a SQLite database file.
        
        .. image:: https://badge.fury.io/py/sqlitebiter.svg
            :target: https://badge.fury.io/py/sqlitebiter
        
        .. image:: https://img.shields.io/pypi/pyversions/sqlitebiter.svg
           :target: https://pypi.python.org/pypi/sqlitebiter
        
        .. image:: https://img.shields.io/travis/thombashi/sqlitebiter/master.svg?label=Linux/macOS
           :target: https://travis-ci.org/thombashi/sqlitebiter
           :alt: Linux CI test status
        
        .. image:: https://img.shields.io/appveyor/ci/thombashi/sqlitebiter/master.svg?label=Windows
           :target: https://ci.appveyor.com/project/thombashi/sqlitebiter
           :alt: Windows CI test status
        
        .. image:: https://img.shields.io/github/stars/thombashi/sqlitebiter.svg?style=social&label=Star
           :target: https://github.com/thombashi/sqlitebiter
           :alt: GitHub repository
        
        Features
        --------
        - Create a SQLite database file from:
            - File(s):
                - CSV
                - Microsoft Excel :superscript:`TM`
                - HTML
                - JSON
                - `Jupyter Notebook <http://jupyter.org/>`__
                - `Labeled Tab-separated Values (LTSV) <http://ltsv.org/>`__
                - `Line-delimited JSON(LDJSON) <https://en.wikipedia.org/wiki/JSON_streaming#Line-delimited_JSON>`__/NDJSON/JSON Lines
                - Markdown
                - Mediawiki
                - Space separated values (SSV)
                - SQLite
                - Tab separated values (TSV)
            - `Google Sheets <https://www.google.com/intl/en_us/sheets/about/>`_
            - URL (scrape data from web pages)
        - Multi-byte character support
        - Automatic file encoding detection
        
        Usage
        =======
        Create SQLite database from files
        -----------------------------------
        .. image:: docs/gif/usage_example.gif
        
        Create SQLite database from URL
        ---------------------------------
        Following is an example that convert HTML table tags within a web page to SQLite tables.
        
        :Example:
            .. code-block:: console
        
                $ sqlitebiter url "https://en.wikipedia.org/wiki/Comparison_of_firewalls"
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html1' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html2' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html3' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html4' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html5' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html6' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html7' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html8' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html9' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html10' table
                [INFO] sqlitebiter url: convert 'en.wikipedia.org/wiki/Comparison_of_firewalls' to 'Comparison_of_firewalls_Wikipedia_html11' table
                [INFO] sqlitebiter url: number of created tables: 11
                [INFO] sqlitebiter url: database path: out.sqlite
        
        :Output:
            .. code-block:: console
        
                sqlite> .schema
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html1' (Firewall TEXT, License TEXT, Costandusagelimits TEXT, OS TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html2' (Firewall TEXT, License TEXT, Cost TEXT, OS TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html3' (CanTarget TEXT, Changingdefaultpolicytoacceptrejectbyissuingasinglerule TEXT, IPdestinationaddresses TEXT, IPsourceaddresses TEXT, TCPUDPdestinationports TEXT, TCPUDPsourceports TEXT, EthernetMACdestinationaddress TEXT, EthernetMACsourceaddress TEXT, Inboundfirewallingress TEXT, Outboundfirewallegress TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html4' (Can TEXT, [workatOSILayer4statefulfirewall] TEXT, [workatOSILayer7applicationinspection] TEXT, ChangeTTLTransparenttotraceroute TEXT, ConfigureREJECTwithanswer TEXT, DMZdemilitarizedzoneallowsforsingleseveralhostsnottobefirewalled TEXT, Filteraccordingtotimeofday TEXT, RedirectTCPUDPportsportforwarding TEXT, RedirectIPaddressesforwarding TEXT, FilteraccordingtoUserAuthorization TEXT, TrafficratelimitQoS TEXT, Tarpit TEXT, Log TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html5' (Features TEXT, ConfigurationGUItextorbothmodes TEXT, [RemoteAccessWebHTTPTelnetSSHRDPSerialCOMRS232] TEXT, Changeruleswithoutrequiringrestart TEXT, Abilitytocentrallymanageallfirewallstogether TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html6' (Features TEXT, Modularitysupportsthirdpartymodulestoextendfunctionality TEXT, [IPS : Intrusion prevention system] TEXT, OpenSourceLicense TEXT, [supports IPv6 ?] TEXT, ClassHomeProfessional TEXT, OperatingSystemsonwhichitruns TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html7' (Can TEXT, [NAT44staticdynamicwoportsPAT] TEXT, [NAT64NPTv6] TEXT, IDSIntrusionDetectionSystem TEXT, VPNVirtualPrivateNetwork TEXT, AVAntiVirus TEXT, Sniffer TEXT, Profileselection TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html9' (A TEXT, B TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html10' (A TEXT, B TEXT);
                CREATE TABLE 'Comparison_of_firewalls_Wikipedia_html11' (A TEXT, B TEXT);
        
        For more information
        ~~~~~~~~~~~~~~~~~~~~~~
        More examples are available at 
        http://sqlitebiter.rtfd.io/en/latest/pages/usage/index.html
        
        Installation
        ============
        
        Install via pip (recommended)
        ------------------------------
        ``sqlitebiter`` can be installed via
        `pip <https://pip.pypa.io/en/stable/installing/>`__ (Python package manager).
        
        :Example:
            .. code:: console
        
                pip install sqlitebiter
        
        
        Installation for Debian/Ubuntu from a deb package
        ----------------------------------------------------------
        #. ``wget https://github.com/thombashi/sqlitebiter/releases/download/<version>/sqlitebiter_<version>_amd64.deb``
        #. ``dpkg -iv sqlitebiter_<version>_amd64.deb``
        
        :Example:
            .. code:: console
        
                $ wget https://github.com/thombashi/sqlitebiter/releases/download/v0.12.0/sqlitebiter_0.12.0_amd64.deb
                $ sudo dpkg -i sqlitebiter_0.12.0_amd64.deb
        
        
        Installing executable files in Windows
        ----------------------------------------------------------
        ``sqlitebiter`` can be used in Windows environments without Python installation as follows:
        
        #. Navigate to https://github.com/thombashi/sqlitebiter/releases
        #. Download the latest version of the ``sqlitebiter_win_x64.zip``
        #. Unzip the file
        #. Execute ``sqlitebiter.exe`` in either Command Prompt or PowerShell
        
        .. code-block:: batch
        
            >cd sqlitebiter_win_x64
            >sqlitebiter.exe -h
            Usage: sqlitebiter.exe [OPTIONS] COMMAND [ARGS]...
        
            Options:
              --version         Show the version and exit.
              -a, --append      append table(s) to existing database.
              -i, --index TEXT  comma separated attribute names to create indices.
              -v, --verbose
              --debug           for debug print.
              --quiet           suppress execution log messages.
              -h, --help        Show this message and exit.
        
            Commands:
              configure  Configure the following application settings:...
              file       Convert tabular data within...
              gs         Convert a spreadsheet in Google Sheets to a...
              url        Scrape tabular data from a URL and convert...
        
        
        Installation for macOS via Homebrew
        ----------------------------------------------------------
        
        .. code:: console
        
            $ brew tap thombashi/sqlitebiter
            $ brew install sqlitebiter
        
        - `Homebrew Formula <https://github.com/thombashi/homebrew-sqlitebiter>`__
        
        
        Bash Auto Completion
        ----------------------------------------------------------
        .. code:: console
        
            $ wget https://raw.githubusercontent.com/thombashi/sqlitebiter/master/scripts/sqlitebiter-complete.sh -O - >> ~/.bash_profile
            $ source ~/.bash_profile
        
        
        Dependencies
        ============
        Python 2.7+ or 3.4+
        
        Python package dependencies are as follows.
        
        Python package dependencies
        ------------------------------------------------------------
        
        Mandatory dependencies
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
        Following mandatory Python packages are automatically installed during
        ``sqlitebiter`` installation process:
        
        - `appconfigpy <https://github.com/thombashi/appconfigpy>`__
        - `click <http://click.pocoo.org/>`__
        - `nbformat <http://jupyter.org/>`__
        - `logbook <http://logbook.readthedocs.io/en/stable/>`__
        - `path.py <https://github.com/jaraco/path.py>`__
        - `pytablereader <https://github.com/thombashi/pytablereader>`__
        - `SimpleSQLite <https://github.com/thombashi/SimpleSQLite>`__
        - `sqliteschema <https://github.com/thombashi/sqliteschema>`__
        - `typepy <https://github.com/thombashi/typepy>`__
        
        Google Sheets dependencies (Optional)
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
        Following Python packages are required to
        `manual installation <http://sqlitebiter.readthedocs.io/en/latest/pages/usage/gs/index.html>`_
        when you use Google Sheets feature:
        
        - `gspread <https://github.com/burnash/gspread>`_
        - `oauth2client <https://github.com/google/oauth2client/>`_
        - `pyOpenSSL <https://pyopenssl.readthedocs.io/en/stable/>`_
        
        The above packages can be installed with the following pip command;
        
        .. code:: console
        
            $ pip install sqlitebiter[gs]
        
        Test dependencies
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
        - `pytablewriter <https://github.com/thombashi/pytablewriter>`__
        - `pytest <http://pytest.org/latest/>`__
        - `pytest-runner <https://pypi.python.org/pypi/pytest-runner>`__
        - `responses <https://github.com/getsentry/responses>`__
        - `tox <https://testrun.org/tox/latest/>`__
        
        Misc dependencies (Optional)
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
        - `lxml <http://lxml.de/installation.html>`__
        - `pypandoc <https://github.com/bebraw/pypandoc>`__
            - required when converting MediaWiki files
        
        
        Dependencies other than Python packages (Optional)
        ------------------------------------------------------------
        - ``libxml2`` (faster HTML/Markdown conversion)
        - `pandoc <http://pandoc.org/>`__ (required when converting MediaWiki files)
        
        Documentation
        ===============
        http://sqlitebiter.rtfd.io/
        
        
Keywords: SQLite,converter,CSV,Excel,Google Sheets,HTML,JSON,LTSV,TSV
Platform: UNKNOWN
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Framework :: Jupyter
Classifier: Intended Audience :: Information Technology
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: MacOS
Classifier: Operating System :: Microsoft
Classifier: Operating System :: Microsoft :: Windows
Classifier: Operating System :: POSIX
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.4
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Topic :: Database
Requires-Python: >=2.7,!=3.0.*,!=3.1.*,!=3.2.*
Provides-Extra: test
Provides-Extra: gs
Provides-Extra: build
Provides-Extra: release
Provides-Extra: docs
