Metadata-Version: 1.0
Name: webhdfspy
Version: 0.3.2
Summary: A wrapper library to access Hadoop HTTP REST API
Home-page: https://github.com/fasouto/webhdfspy
Author: Fabio Souto
Author-email: fabio@fabiosouto.me
License: MIT
Description: =========
        webhdfspy
        =========
        
        .. image:: https://badge.fury.io/py/webhdfspy.svg
            :target: http://badge.fury.io/py/webhdfspy
        
        A Python 2/3 wrapper library to access `Hadoop WebHDFS REST API <https://hadoop.apache.org/docs/r1.0.4/webhdfs.html>`_
        
        
        Installation
        ============
        
        To install webhdfspy from PyPI::
        
            $ pip install webhdfspy
        
        
        Python versions
        ===============
        
        webhdfspy supports Python 2.7 and 3.4
        
        
        Usage
        =====
        ::
            
            >>> import webhdfspy
            >>> webHDFS = webhdfspy.WebHDFSClient("localhost", 50070, "username")
            >>> print(webHDFS.listdir('/'))
            []
            >>> webHDFS.mkdir('/foo')
            True
            >>> print(webHDFS.listdir('/'))
            [{u'group': u'supergroup', u'permission': u'755', u'blockSize': 0, u'accessTime': 0, u'pathSuffix': u'foo', u'modificationTime': 1429805040695, u'replication': 0, u'length': 0, u'childrenNum': 0, u'owner': u'username', u'storagePolicy': 0, u'type': u'DIRECTORY', u'fileId': 16387}]
            >>> print webHDFS.create('/foo/foo.txt', "just put some text here", True)
            True
            >>> print webHDFS.open('/pywebhdfs_test/foo.txt') 
            just put some text here
            >>> webHDFS.remove('/foo')
            True
            >>> print(webHDFS.listdir('/'))
            []
        
        Documentation
        =============
        
        http://webhdfspy.readthedocs.org/en/latest/
        
        
        Hadoop configuration
        ====================
        
        To enable WebHDFS in Hadoop add this to your $HADOOP_DIR/conf/hdfs-site.xml: ::
        
                <property>
                     <name>dfs.webhdfs.enabled</name>
                     <value>true</value>
                </property>  
        
        To enable append on HDFS you need to configure your hdfs-site.xml as follows: ::
        
                <property>
                    <name>dfs.support.append</name>
                    <value>true</value>
                </property>
        
        
        More about WebHDFS: http://hadoop.apache.org/common/docs/r1.0.0/webhdfs.html
        
        
Keywords: hadoop webhdfs
Platform: UNKNOWN
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 2.7
Classifier: Topic :: Software Development :: Libraries
