[−][src]Crate rust_hdfs
Re-exports
pub use hdfs_fs::*; |
Modules
hdfs_fs |
Structs
__fsid_t | |
__locale_data | |
__locale_struct | |
flock | |
hadoopRzBuffer | |
hadoopRzOptions | |
hdfsBuilder | Some utility decls used in libhdfs. |
hdfsFileInfo | hdfsFileInfo - Information about a file/directory. |
hdfsFile_internal | |
hdfsHedgedReadMetrics | |
hdfsReadStatistics | |
hdfsStreamBuilder | |
hdfs_internal | The C reflection of org.apache.org.hadoop.FileSystem . |
itimerspec | |
sigevent | |
stat | |
timespec | |
tm |
Constants
Statics
__daylight | |
__timezone | |
__tzname | |
daylight | |
timezone | |
tzname |
Functions
__errno_location⚠ | |
asctime⚠ | |
asctime_r⚠ | |
clock⚠ | |
clock_getcpuclockid⚠ | |
clock_getres⚠ | |
clock_gettime⚠ | |
clock_nanosleep⚠ | |
clock_settime⚠ | |
creat⚠ | |
ctime⚠ | |
ctime_r⚠ | |
difftime⚠ | |
dysize⚠ | |
fcntl⚠ | |
gmtime⚠ | |
gmtime_r⚠ | |
hadoopReadZero⚠ | Perform a byte buffer read. If possible, this will be a zero-copy (mmap) read. |
hadoopRzBufferFree⚠ | Release a buffer obtained through readZero. |
hadoopRzBufferGet⚠ | Get a pointer to the raw buffer returned from readZero. |
hadoopRzBufferLength⚠ | Determine the length of the buffer returned from readZero. |
hadoopRzOptionsAlloc⚠ | Allocate a zero-copy options structure. |
hadoopRzOptionsFree⚠ | Free a hadoopRzOptionsFree structure. |
hadoopRzOptionsSetByteBufferPool⚠ | Set the ByteBufferPool to use with read0. |
hadoopRzOptionsSetSkipChecksum⚠ | Determine whether we should skip checksums in read0. |
hdfsAvailable⚠ | hdfsAvailable - Number of bytes that can be read from this input stream without blocking. @param fs The configured filesystem handle. @param file The file handle. @return Returns available bytes; -1 on error. |
hdfsBuilderConfSetStr⚠ | Set a configuration string for an HdfsBuilder. |
hdfsBuilderConnect⚠ | Connect to HDFS using the parameters defined by the builder. |
hdfsBuilderSetForceNewInstance⚠ | Force the builder to always create a new instance of the FileSystem, rather than possibly finding one in the cache. |
hdfsBuilderSetKerbTicketCachePath⚠ | Set the path to the Kerberos ticket cache to use when connecting to the HDFS cluster. |
hdfsBuilderSetNameNode⚠ | Set the HDFS NameNode to connect to. |
hdfsBuilderSetNameNodePort⚠ | Set the port of the HDFS NameNode to connect to. |
hdfsBuilderSetUserName⚠ | Set the username to use when connecting to the HDFS cluster. |
hdfsChmod⚠ | hdfsChmod @param fs The configured filesystem handle. @param path the path to the file or directory @param mode the bitmask to set it to @return 0 on success else -1 |
hdfsChown⚠ | Change the user and/or group of a file or directory. |
hdfsCloseFile⚠ | hdfsCloseFile - Close an open file. @param fs The configured filesystem handle. @param file The file handle. @return Returns 0 on success, -1 on error. On error, errno will be set appropriately. If the hdfs file was valid, the memory associated with it will be freed at the end of this call, even if there was an I/O error. |
hdfsConfGetInt⚠ | Get a configuration integer. |
hdfsConfGetStr⚠ | Get a configuration string. |
hdfsConfStrFree⚠ | Free a configuration string found with hdfsConfGetStr. |
hdfsConnect⚠ | hdfsConnect - Connect to a hdfs file system. Connect to the hdfs. @param nn The NameNode. See hdfsBuilderSetNameNode for details. @param port The port on which the server is listening. @return Returns a handle to the filesystem or NULL on error. @deprecated Use hdfsBuilderConnect instead. |
hdfsConnectAsUser⚠ | hdfsConnectAsUser - Connect to a hdfs file system as a specific user Connect to the hdfs. @param nn The NameNode. See hdfsBuilderSetNameNode for details. @param port The port on which the server is listening. @param user the user name (this is hadoop domain user). Or NULL is equivelant to hhdfsConnect(host, port) @return Returns a handle to the filesystem or NULL on error. @deprecated Use hdfsBuilderConnect instead. |
hdfsConnectAsUserNewInstance⚠ | hdfsConnect - Connect to an hdfs file system. |
hdfsConnectNewInstance⚠ | hdfsConnect - Connect to an hdfs file system. |
hdfsCopy⚠ | hdfsCopy - Copy file from one filesystem to another. @param srcFS The handle to source filesystem. @param src The path of source file. @param dstFS The handle to destination filesystem. @param dst The path of destination file. @return Returns 0 on success, -1 on error. |
hdfsCreateDirectory⚠ | hdfsCreateDirectory - Make the given file and all non-existent parents into directories. @param fs The configured filesystem handle. @param path The path of the directory. @return Returns 0 on success, -1 on error. |
hdfsDelete⚠ | hdfsDelete - Delete file. @param fs The configured filesystem handle. @param path The path of the file. @param recursive if path is a directory and set to non-zero, the directory is deleted else throws an exception. In case of a file the recursive argument is irrelevant. @return Returns 0 on success, -1 on error. |
hdfsDisconnect⚠ | hdfsDisconnect - Disconnect from the hdfs file system. Disconnect from hdfs. @param fs The configured filesystem handle. @return Returns 0 on success, -1 on error. Even if there is an error, the resources associated with the hdfsFS will be freed. |
hdfsExists⚠ | hdfsExists - Checks if a given path exsits on the filesystem @param fs The configured filesystem handle. @param path The path to look for @return Returns 0 on success, -1 on error. |
hdfsFileClearReadStatistics⚠ | Clear the read statistics for a file. |
hdfsFileFreeReadStatistics⚠ | Free some HDFS read statistics. |
hdfsFileGetReadStatistics⚠ | Get read statistics about a file. This is only applicable to files opened for reading. |
hdfsFileIsEncrypted⚠ | hdfsFileIsEncrypted: determine if a file is encrypted based on its hdfsFileInfo. @return -1 if there was an error (errno will be set), 0 if the file is not encrypted, 1 if the file is encrypted. |
hdfsFileIsOpenForRead⚠ | Determine if a file is open for read. |
hdfsFileIsOpenForWrite⚠ | Determine if a file is open for write. |
hdfsFlush⚠ | hdfsWrite - Flush the data. @param fs The configured filesystem handle. @param file The file handle. @return Returns 0 on success, -1 on error. |
hdfsFreeBuilder⚠ | Free an HDFS builder. |
hdfsFreeFileInfo⚠ | hdfsFreeFileInfo - Free up the hdfsFileInfo array (including fields) @param hdfsFileInfo The array of dynamically-allocated hdfsFileInfo objects. @param numEntries The size of the array. |
hdfsFreeHedgedReadMetrics⚠ | Free HDFS Hedged read metrics. |
hdfsFreeHosts⚠ | hdfsFreeHosts - Free up the structure returned by hdfsGetHosts @param hdfsFileInfo The array of dynamically-allocated hdfsFileInfo objects. @param numEntries The size of the array. |
hdfsGetCapacity⚠ | hdfsGetCapacity - Return the raw capacity of the filesystem. @param fs The configured filesystem handle. @return Returns the raw-capacity; -1 on error. |
hdfsGetDefaultBlockSize⚠ | hdfsGetDefaultBlockSize - Get the default blocksize. |
hdfsGetDefaultBlockSizeAtPath⚠ | hdfsGetDefaultBlockSizeAtPath - Get the default blocksize at the filesystem indicated by a given path. |
hdfsGetHedgedReadMetrics⚠ | Get cluster wide hedged read metrics. |
hdfsGetHosts⚠ | hdfsGetHosts - Get hostnames where a particular block (determined by pos & blocksize) of a file is stored. The last element in the array is NULL. Due to replication, a single block could be present on multiple hosts. @param fs The configured filesystem handle. @param path The path of the file. @param start The start of the block. @param length The length of the block. @return Returns a dynamically-allocated 2-d array of blocks-hosts; NULL on error. |
hdfsGetLastExceptionRootCause⚠ | Get the last exception root cause that happened in the context of the current thread, i.e. the thread that called into libHDFS. |
hdfsGetLastExceptionStackTrace⚠ | Get the last exception stack trace that happened in the context of the current thread, i.e. the thread that called into libHDFS. |
hdfsGetPathInfo⚠ | hdfsGetPathInfo - Get information about a path as a (dynamically allocated) single hdfsFileInfo struct. hdfsFreeFileInfo should be called when the pointer is no longer needed. @param fs The configured filesystem handle. @param path The path of the file. @return Returns a dynamically-allocated hdfsFileInfo object; NULL on error. |
hdfsGetUsed⚠ | hdfsGetUsed - Return the total raw size of all files in the filesystem. @param fs The configured filesystem handle. @return Returns the total-size; -1 on error. |
hdfsGetWorkingDirectory⚠ | hdfsGetWorkingDirectory - Get the current working directory for the given filesystem. @param fs The configured filesystem handle. @param buffer The user-buffer to copy path of cwd into. @param bufferSize The length of user-buffer. @return Returns buffer, NULL on error. |
hdfsHFlush⚠ | hdfsHFlush - Flush out the data in client's user buffer. After the return of this call, new readers will see the data. @param fs configured filesystem handle @param file file handle @return 0 on success, -1 on error and sets errno |
hdfsHSync⚠ | hdfsHSync - Similar to posix fsync, Flush out the data in client's user buffer. all the way to the disk device (but the disk may have it in its cache). @param fs configured filesystem handle @param file file handle @return 0 on success, -1 on error and sets errno |
hdfsListDirectory⚠ | hdfsListDirectory - Get list of files/directories for a given directory-path. hdfsFreeFileInfo should be called to deallocate memory. @param fs The configured filesystem handle. @param path The path of the directory. @param numEntries Set to the number of files/directories in path. @return Returns a dynamically-allocated array of hdfsFileInfo objects; NULL on error or empty directory. errno is set to non-zero on error or zero on success. |
hdfsMove⚠ | hdfsMove - Move file from one filesystem to another. @param srcFS The handle to source filesystem. @param src The path of source file. @param dstFS The handle to destination filesystem. @param dst The path of destination file. @return Returns 0 on success, -1 on error. |
hdfsNewBuilder⚠ | Create an HDFS builder. |
hdfsOpenFile⚠ | hdfsOpenFile - Open a hdfs file in given mode. @deprecated Use the hdfsStreamBuilder functions instead. This function does not support setting block sizes bigger than 2 GB. |
hdfsPread⚠ | hdfsPread - Positional read of data from an open file. @param fs The configured filesystem handle. @param file The file handle. @param position Position from which to read @param buffer The buffer to copy read bytes into. @param length The length of the buffer. @return See hdfsRead |
hdfsRead⚠ | hdfsRead - Read data from an open file. @param fs The configured filesystem handle. @param file The file handle. @param buffer The buffer to copy read bytes into. @param length The length of the buffer. @return On success, a positive number indicating how many bytes were read. On end-of-file, 0. On error, -1. Errno will be set to the error code. Just like the POSIX read function, hdfsRead will return -1 and set errno to EINTR if data is temporarily unavailable, but we are not yet at the end of the file. |
hdfsReadStatisticsGetRemoteBytesRead⚠ | @param stats HDFS read statistics for a file. |
hdfsRename⚠ | hdfsRename - Rename file. @param fs The configured filesystem handle. @param oldPath The path of the source file. @param newPath The path of the destination file. @return Returns 0 on success, -1 on error. |
hdfsSeek⚠ | hdfsSeek - Seek to given offset in file. This works only for files opened in read-only mode. @param fs The configured filesystem handle. @param file The file handle. @param desiredPos Offset into the file to seek into. @return Returns 0 on success, -1 on error. |
hdfsSetReplication⚠ | hdfsSetReplication - Set the replication of the specified file to the supplied value @param fs The configured filesystem handle. @param path The path of the file. @return Returns 0 on success, -1 on error. |
hdfsSetWorkingDirectory⚠ | hdfsSetWorkingDirectory - Set the working directory. All relative paths will be resolved relative to it. @param fs The configured filesystem handle. @param path The path of the new 'cwd'. @return Returns 0 on success, -1 on error. |
hdfsStreamBuilderAlloc⚠ | hdfsStreamBuilderAlloc - Allocate an HDFS stream builder. |
hdfsStreamBuilderBuild⚠ | hdfsStreamBuilderBuild - Build the stream by calling open or create. |
hdfsStreamBuilderFree⚠ | hdfsStreamBuilderFree - Free an HDFS file builder. |
hdfsStreamBuilderSetBufferSize⚠ | hdfsStreamBuilderSetBufferSize - Set the stream buffer size. |
hdfsStreamBuilderSetDefaultBlockSize⚠ | hdfsStreamBuilderSetDefaultBlockSize - Set the default block size for the stream. This is only relevant for output streams, which will create new blocks. |
hdfsStreamBuilderSetReplication⚠ | hdfsStreamBuilderSetReplication - Set the replication for the stream. This is only relevant for output streams, which will create new blocks. |
hdfsTell⚠ | hdfsTell - Get the current offset in the file, in bytes. @param fs The configured filesystem handle. @param file The file handle. @return Current offset, -1 on error. |
hdfsTruncateFile⚠ | hdfsTruncateFile - Truncate a hdfs file to given lenght. @param fs The configured filesystem handle. @param path The full path to the file. @param newlength The size the file is to be truncated to @return 1 if the file has been truncated to the desired newlength and is immediately available to be reused for write operations such as append. 0 if a background process of adjusting the length of the last block has been started, and clients should wait for it to complete before proceeding with further file updates. -1 on error. |
hdfsUnbufferFile⚠ | hdfsUnbufferFile - Reduce the buffering done on a file. |
hdfsUtime⚠ | hdfsUtime @param fs The configured filesystem handle. @param path the path to the file or directory @param mtime new modification time or -1 for no change @param atime new access time or -1 for no change @return 0 on success else -1 |
hdfsWrite⚠ | hdfsWrite - Write data into an open file. @param fs The configured filesystem handle. @param file The file handle. @param buffer The data. @param length The no. of bytes to write. @return Returns the number of bytes written, -1 on error. |
localtime⚠ | |
localtime_r⚠ | |
lockf⚠ | |
mktime⚠ | |
nanosleep⚠ | |
open⚠ | |
openat⚠ | |
posix_fadvise⚠ | |
posix_fallocate⚠ | |
stime⚠ | |
strftime⚠ | |
strftime_l⚠ | |
time⚠ | |
timegm⚠ | |
timelocal⚠ | |
timer_create⚠ | |
timer_delete⚠ | |
timer_getoverrun⚠ | |
timer_gettime⚠ | |
timer_settime⚠ | |
timespec_get⚠ | |
tzset⚠ |